-- Logs begin at Thu 2022-09-29 01:31:28 UTC, end at Thu 2022-09-29 02:29:05 UTC. -- Sep 29 01:56:59.912425 dv-cinder-733062-36-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 29 01:56:59.921063 dv-cinder-733062-36-smb devstack@keystone.service[81542]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 29 01:56:59 2022] *** Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: nodename: dv-cinder-733062-36-smb Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: machine: x86_64 Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: clock source: unix Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: pcre jit disabled Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: detected number of CPU cores: 4 Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: current working directory: / Sep 29 01:56:59.923123 dv-cinder-733062-36-smb devstack@keystone.service[81542]: detected binary path: /usr/bin/uwsgi-core Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: your processes number limit is 47680 Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: your memory page size is 4096 bytes Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: detected max file descriptor number: 2048 Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: lock engine: pthread robust mutexes Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: thunder lock: enabled Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 29 01:56:59.923663 dv-cinder-733062-36-smb devstack@keystone.service[81542]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 29 01:56:59.963527 dv-cinder-733062-36-smb devstack@keystone.service[81542]: Python main interpreter initialized at 0x55e938bd69c0 Sep 29 01:56:59.963527 dv-cinder-733062-36-smb devstack@keystone.service[81542]: python threads support enabled Sep 29 01:56:59.963527 dv-cinder-733062-36-smb devstack@keystone.service[81542]: your server socket listen backlog is limited to 100 connections Sep 29 01:56:59.963527 dv-cinder-733062-36-smb devstack@keystone.service[81542]: your mercy for graceful operations on workers is 90 seconds Sep 29 01:56:59.963848 dv-cinder-733062-36-smb devstack@keystone.service[81542]: mapped 403077 bytes (393 KB) for 2 cores Sep 29 01:56:59.963937 dv-cinder-733062-36-smb devstack@keystone.service[81542]: *** Operational MODE: preforking *** Sep 29 01:56:59.964214 dv-cinder-733062-36-smb devstack@keystone.service[81542]: *** uWSGI is running in multiple interpreter mode *** Sep 29 01:56:59.964214 dv-cinder-733062-36-smb devstack@keystone.service[81542]: spawned uWSGI master process (pid: 81542) Sep 29 01:56:59.964405 dv-cinder-733062-36-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 29 01:56:59.964999 dv-cinder-733062-36-smb devstack@keystone.service[81542]: spawned uWSGI worker 1 (pid: 81553, cores: 1) Sep 29 01:56:59.965274 dv-cinder-733062-36-smb devstack@keystone.service[81542]: spawned uWSGI worker 2 (pid: 81554, cores: 1) Sep 29 01:56:59.965429 dv-cinder-733062-36-smb devstack@keystone.service[81542]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 29 01:57:04.248732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:04.248732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: from cryptography.utils import int_from_bytes Sep 29 01:57:04.249602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:04.249602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: from cryptography.utils import int_from_bytes Sep 29 01:57:04.250947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:04.250947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Sep 29 01:57:04.251400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:04.251400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Sep 29 01:57:04.298594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 01:57:04.298790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 01:57:04.298980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] command line args: [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 01:57:04.299248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 01:57:04.299424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ================================================================================ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 01:57:04.299677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] admin_token = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.299920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_dir = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.300106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.300286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_source = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.300463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] debug = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.300662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.300907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 01:57:04.300907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 01:57:04.301034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.301092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] command line args: [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 01:57:04.301231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.301310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 01:57:04.301429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.301545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ================================================================================ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 01:57:04.302269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_dir = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_config_append = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.302920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_source = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_dir = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] debug = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.303984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_config_append = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_dir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.304987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.305879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.306874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] publish_errors = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.307904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] standard_threads = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.308825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] publish_errors = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_journal = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_json = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_stderr = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.309951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_syslog = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.310582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.310652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] standard_threads = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.310893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.311065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.311244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.311423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_journal = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.311612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_json = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_stderr = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.311921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_syslog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.311991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:04.312243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.312997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.313993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.314969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.315941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.316883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.317938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.318924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.319997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.320917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.321948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.322864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.323954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.324962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.325926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.326864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.327950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.328988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.329941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.330875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.331994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.332966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.333998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.334958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.335974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.external = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.336944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.password = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.token = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.337894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.external = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.338856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.password = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.token = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.339973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.340927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.341926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.342993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343867 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.343945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.344913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.345936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.346902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.347989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.348069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.348238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.348325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.348469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.349889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.350848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.351952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.352969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.353980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.354898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.355990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.356960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.357933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.358996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.359959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.360998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.361953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.362941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.363864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.364020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.364153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.364869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.364955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.365951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.366913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.367946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.368891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.369887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.370987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.371930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.372975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.373951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.374937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.375969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.376943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.377874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.378864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.379992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.380962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.381931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.382961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.383932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.384894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.385998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.386942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.387967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 01:57:04.388610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.388851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.389097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.389336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.389614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.389857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.390104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.390339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.390582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.390819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:04.390991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 01:57:04.422830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.423054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.423380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.426020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.426323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.426558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.432668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.437485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.463744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.463975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.471326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.471563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.517376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.518305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.566118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.566346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.567822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.568061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.722482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.722649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.722720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.722846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.722932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.723064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.723150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.723280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.723365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.724028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.724158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.724407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.747526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.747761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.747858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.747977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.748935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.749080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.760121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.760558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.772784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.773909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.774054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.774139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.774276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.774496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.774715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.791465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.791676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.792022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.792106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.792226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.792310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.792502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.792643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.792763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.792846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.793024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.793115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.793284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.793366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.793643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.793909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.803865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.804784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.805000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.811662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.812037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.814598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.814887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.814971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.815172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.815255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.815456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.815540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.815742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.815826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.816904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.817096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.817178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.817934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.818070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.818228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.841225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.841969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.842717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.843002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.843446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.843738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.847710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.847995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.848275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.848449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.848767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.849226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.854739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.855029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.855616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.855907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.860605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.860897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.861180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.861460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.861602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.861758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.861903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.862750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.863026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.863311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.863573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.878025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.878300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.879703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.880507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.882797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.884339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.886075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.886371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.887550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.887850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.890568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.892032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.893802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.895140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.897587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.897886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.898170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.898453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.898738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.898930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.899015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.899239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.899527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.899814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.900096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.900379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.915032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.915320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.915586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.915848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.916251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.916547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.916820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.917087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.922683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.923985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.924209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.925564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.925765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.926041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.927407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.927692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.929152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.929441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.929754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.930035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.930418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.930550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.930864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.931153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.931440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.931837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.941528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.941818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.942099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.942912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.943352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.943652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.943736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.943932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.944017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.944237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.944522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.944915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.945198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.945485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.959340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.960990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.962261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.964212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.965386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.967012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.967146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.968650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.968735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.968935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.969337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.970176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.970477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.970882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.976354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.977785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.977914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.979403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.980668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.981064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.981351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.981654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.982328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.982729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.983033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.983302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.989961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.990252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.990533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.991736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.992035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.992323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.997352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.997662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.997974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.998218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.998489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.998765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.999334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.999902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.000965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.001161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.001444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.001760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.002039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.002304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.002573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.002850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:05.034970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e938bd69c0 pid: 81553 (default app) Sep 29 01:57:05.037452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e938bd69c0 pid: 81554 (default app) Sep 29 01:57:05.038911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32317f-d21b-4861-be10-ee4172e434db None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:05.039201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32317f-d21b-4861-be10-ee4172e434db None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:05.039472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32317f-d21b-4861-be10-ee4172e434db None None] PATH_INFO: `/v3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:05.043585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Sep 29 01:57:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:11.799671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:11.800197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:11.800197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:11.804436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:11.809824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:11.810402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:11.810402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:11.880720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: INFO dbcounter [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] Registered counter for database keystone Sep 29 01:57:11.899411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG oslo_db.sqlalchemy.engines [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 01:57:11.905564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writer thread running {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 01:57:12.083292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG passlib.handlers.bcrypt [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81553) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 29 01:57:12.083561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG passlib.handlers.bcrypt [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81553) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 29 01:57:12.142233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:12.143828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:12.269637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 29 01:57:12.718855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:12.788442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: INFO dbcounter [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] Registered counter for database keystone Sep 29 01:57:12.809516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG oslo_db.sqlalchemy.engines [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 01:57:12.815744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writer thread running {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 01:57:12.934032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016648-4762-4c2d-a232-fd5e038be112 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:12.938345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:12.938973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:12.939259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:12.939530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:12.947754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:13.000088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 29 01:57:13.000380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbd555-4df9-45ef-ad55-46ba4905c24a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:13.010368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Sep 29 01:57:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 01:57:13.016387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:13.033853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b499d-0545-4b6e-835b-2967d9aea68e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:13.038402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:13.039508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:13.039794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:13.040071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] PATH_INFO: `/v3/projects/2044597fee4e41239b157ed6c7f1c415` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:13.041681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] RBAC: Authorizing `identity:get_project(project_id=2044597fee4e41239b157ed6c7f1c415)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:13.095347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 29 01:57:13.095709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008d6c-03c4-474c-8f8f-61be7e882901 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:13.101191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Sep 29 01:57:13 2022] GET /identity/v3/projects/2044597fee4e41239b157ed6c7f1c415 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:15.231850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fbac-838f-4ddc-abb2-42cc679c51b3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:15.232401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fbac-838f-4ddc-abb2-42cc679c51b3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:15.232401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fbac-838f-4ddc-abb2-42cc679c51b3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:15.236503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:15.242493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:15.242943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:15.243037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:15.262723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:15.264254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:15.272143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 29 01:57:15.537927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9fbac-838f-4ddc-abb2-42cc679c51b3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:15.549891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9fbac-838f-4ddc-abb2-42cc679c51b3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:15.554991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:15.555589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:15.555873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:15.556147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:15.563685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:15.565463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cc003-d2bb-491f-8f30-4824bf4299c8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:15.574302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Sep 29 01:57:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 01:57:15.579565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:15.588894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c3ae-8f5a-4592-961f-c2a59e546f46 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:15.593167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:15.593824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:15.594108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:15.594382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:15.595676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:15.597530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c8ca-aca7-4893-86cb-1acc4b7dabd4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:15.599653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Sep 29 01:57:15 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:17.829733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d4b2-2d4b-43eb-b698-985a88ab1b7f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.830270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d4b2-2d4b-43eb-b698-985a88ab1b7f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.830270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203d4b2-2d4b-43eb-b698-985a88ab1b7f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.831586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:17.837397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.838092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.838433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.856272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:17.857479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:17.871299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d48b-83c6-4fba-9d53-0e02002be1b7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.871587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d48b-83c6-4fba-9d53-0e02002be1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.871864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d48b-83c6-4fba-9d53-0e02002be1b7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.873180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:17.878271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.878559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.878839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.920266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81554) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 29 01:57:17.920658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81554) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 29 01:57:17.939766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:17.970698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:17.972291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:18.076387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:18.206530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.232243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.310964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbc56-bb8c-44e3-ba90-5701667b566b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.343270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.343905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.344187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.344466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.356197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:18.358842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:18.365203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:18.369777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:18.370950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:18.372817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.452515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.461825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089ab8-f24c-4d5b-ace3-d655ef2b2617 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.464368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.473103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334609-5b66-4411-ba37-87b7ed323352 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.498289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.499144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.499430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.499701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.506827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.507435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.507716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.507988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.508653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:18.508965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.510384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.521887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:18.527531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.566918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.569332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.627367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071122c-4186-4c6e-af5d-e2ba53d190bd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.662076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.662745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.663028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.663304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.664431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.665891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.667608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 9/16] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:18.667725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:57:18.672725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.673075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.675881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.688282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.772208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defdc95-dabd-4b39-8f46-ff0d6525a3b5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.772619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0742ee-201f-4c61-bedd-0d4bc5c0c7c3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.806007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.806195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.806642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.806863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.806951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.807144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.807231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.807412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.808300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.809783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.811335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:18.817153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.826507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.828030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:57:18.849792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:18.851193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:57:18.852547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:57:18.852547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:18.852547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:18.852547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:18.856825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.904267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.913691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.924324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58080cc-65b3-4ea1-90dc-26ce8ca0f080 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.958016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.958626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.958904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.959177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.959592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f015-b7b6-4aba-9e81-3bec13568375 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.959897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.domain.id=default, user.id=1d9dd2adfb054acebc7de33da50790a5) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:18.960202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.961682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f035c4-ab94-4ec2-a8e9-4240aaedd326 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.968422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/role_assignments?user.id=1d9dd2adfb054acebc7de33da50790a5&scope.domain.id=default&role.id=91c74d335ba54b558054c228da1b6365 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:18.995313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.995974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.996234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.996506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.997174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:18.997479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.998984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb68b8-4802-4c86-bfcb-88abe733e535 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:19.017696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:21.505035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6cb4-ad5e-4405-8dec-c660485e5812 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.505547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6cb4-ad5e-4405-8dec-c660485e5812 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.505844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6cb4-ad5e-4405-8dec-c660485e5812 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.507306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:21.519181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fb6b-f298-4e91-9d5b-1a978a63e92f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.519656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fb6b-f298-4e91-9d5b-1a978a63e92f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.519827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fb6b-f298-4e91-9d5b-1a978a63e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.546858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8853fb6b-f298-4e91-9d5b-1a978a63e92f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:21.548055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8853fb6b-f298-4e91-9d5b-1a978a63e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.635009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:21.750932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c66-40c7-4dab-8886-7f6a255dfcee None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.751283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c66-40c7-4dab-8886-7f6a255dfcee None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.751486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47c66-40c7-4dab-8886-7f6a255dfcee None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.752816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:21.772003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.772289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.772490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.793227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a1c0-2ea7-43bf-bdbb-5904bc21257a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.793551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a1c0-2ea7-43bf-bdbb-5904bc21257a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.793804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888a1c0-2ea7-43bf-bdbb-5904bc21257a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.795273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:21.800174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.800456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.800731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.803086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:21.804290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.834521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:21.835729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.890937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:21.938540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 12/26] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:21.983691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:22.141666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.271243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3e63-7540-4de4-98e6-c992d669c0ee None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.302629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.318553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.319208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.319487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.319761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.342010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.343904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7cef32e3-7566-48ad-939d-d32cb0d1ae47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:57:22.360048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:22.360901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:57:22.361740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:57:22.361740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:22.361740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:22.361740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:22.363715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7648-edf2-4a14-b758-1f42fa4ef876 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.363715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7648-edf2-4a14-b758-1f42fa4ef876 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.363715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7648-edf2-4a14-b758-1f42fa4ef876 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.368845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 14/29] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:22.370219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7648-edf2-4a14-b758-1f42fa4ef876 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.423496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.461874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.493339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c1eaa-a105-4a49-8505-7f7c92a77a1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.527559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7648-edf2-4a14-b758-1f42fa4ef876 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.538123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.538763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.539044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.539318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.554488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fd9e3d36-f18a-4232-93e7-d63a8ae26b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:22.561571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:22.562405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:22.563167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:22.563819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.571013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.571013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.576641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.577549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.578043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.578535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.579389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:22.579899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.581590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.587390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:22.588843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:22.595160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:22.596258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.678618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:22.679468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.694887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.708443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2ec74-1793-4f24-b1fd-f8986a77a280 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.745163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.746364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.746911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.747388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.748321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.750060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.757859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.800068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147496b8-d46a-49d9-afd3-2aa2d219da90 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.842474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.843511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.844073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.844556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.845536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:22.846101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.847777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.857309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 18/33] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:22.858535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.895874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 16/34] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/roles => generated 219 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:22.897039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.054272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb421eff-b42e-401e-b523-c576ff20e5b0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.111780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.118105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ebb1-9b2a-4d8d-8b71-ac638fb44ea1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.123386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.124006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.124283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.124607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.125267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.126847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.158645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.159611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.159899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.160330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.162664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.164285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aef81-463d-4909-9a6d-8c7285a4aa10 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.166096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:22 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:23.167241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc109-cab7-4ead-8e02-84a20be1c8d2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.167533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc109-cab7-4ead-8e02-84a20be1c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.167812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc109-cab7-4ead-8e02-84a20be1c8d2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.169008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:23.173790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fc109-cab7-4ead-8e02-84a20be1c8d2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.200947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.272742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/projects => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:23.272742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.300814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fc109-cab7-4ead-8e02-84a20be1c8d2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.343913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.344648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.345078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.345486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.346668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.349537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb0a3d-7923-431f-a74f-ed0df1d98ef5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.369370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/roles => generated 225 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:23.370931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.371280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.371658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.395641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:23.397711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:23.428856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b75fba-1583-4d69-8fae-b98f774cded3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.486588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:23.510388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.511412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.511881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.512398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.514083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.516037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b444c2-6633-4263-ace2-a0be679579f2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.518943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:23.526320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.536414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.654341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b7aab-053c-4e61-bee6-257ae538424b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.657117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4061a-3d25-45b3-80fa-21729620dff1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.657644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4061a-3d25-45b3-80fa-21729620dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.657728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4061a-3d25-45b3-80fa-21729620dff1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.659230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 21/41] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:23.664818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779424-d276-4024-b837-a4f922f22417 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.665111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779424-d276-4024-b837-a4f922f22417 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.665400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779424-d276-4024-b837-a4f922f22417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.690073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-37779424-d276-4024-b837-a4f922f22417 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:23.691607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-37779424-d276-4024-b837-a4f922f22417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:23.703975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.704746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.704746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.704999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] PATH_INFO: `/v3/domains/default/users/1d9dd2adfb054acebc7de33da50790a5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.707102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1d9dd2adfb054acebc7de33da50790a5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.709303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.727522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Sep 29 01:57:23 2022] PUT /identity/v3/domains/default/users/1d9dd2adfb054acebc7de33da50790a5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:23.750778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.792015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:23.808154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.884382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.925708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167794-628f-4081-bfe1-80e40a7ff556 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.960714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.961337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.961659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.961939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.962616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.964269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.978825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:24.066626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779424-d276-4024-b837-a4f922f22417 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:24.283084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779424-d276-4024-b837-a4f922f22417 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:24.315459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:24.316095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:24.316382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:24.316662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:24.318485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:24.319944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22286d2-e87e-408d-a667-f7842e21c7d2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:24.321512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:24.327083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:24.425341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178546-1bb6-4781-b45b-c186c317fcba None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:24.450003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:24.459539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:24.460158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:24.460441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:24.460713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:24.461372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:24.463154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ec96-b75a-4eee-a706-2a83894eb421 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:24.491561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:24 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:25.950337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed6e-3f14-416e-9d7f-6120f47b7548 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.950858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed6e-3f14-416e-9d7f-6120f47b7548 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.950965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed6e-3f14-416e-9d7f-6120f47b7548 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.952228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:25.958244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.958650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.958921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.976964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:25.978174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:26.046874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:26.316837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ed6e-3f14-416e-9d7f-6120f47b7548 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.364121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:26.419634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ed6e-3f14-416e-9d7f-6120f47b7548 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.452158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.452788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.453076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.453358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.464278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:26.469184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:26.470037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:26.470789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:26.476975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.578382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92765df-27bd-4c02-91c9-96317d531669 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.589112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:26.614307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.614923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.615207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.615495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.616144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:26.616450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.617859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e11940-92dc-4ed5-a44d-aab07c07d113 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.628848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:26.635653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.636751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467536d6-5dc1-47c3-95ea-00f5e2d7940c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.637044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467536d6-5dc1-47c3-95ea-00f5e2d7940c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.637324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467536d6-5dc1-47c3-95ea-00f5e2d7940c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.638618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 26/51] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:26.643830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.644119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.644394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.748329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b870-6d7e-4c05-921a-70049e90a887 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.750735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:26.765397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:26.766615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:26.785188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.786129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.786410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.786688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.787823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.789292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.790897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 26/52] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:26.796164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.834003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:26.894188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e0328-907a-4d4c-aa60-fdeceb428ff2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.927086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.927705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.927988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.928289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.929407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.930894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.932442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:26.938369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:27.031386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:27.034609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e26b6-5d38-4423-9e5a-9f32d1f7f840 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:27.068800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:27.069409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:27.069719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:27.069997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:27.070726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.domain.id=default, user.id=1d9dd2adfb054acebc7de33da50790a5) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:27.071037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:27.072539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:27.080240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/role_assignments?user.id=1d9dd2adfb054acebc7de33da50790a5&scope.domain.id=default&role.id=91c74d335ba54b558054c228da1b6365 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:27.102865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:27.148330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:27.210432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea3738-d819-41ce-9e78-9ea3449bd5e0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:27.246310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:27.247023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:27.247311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:27.247589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:27.248761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:27.250281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66abc-5fdf-48f8-bf7a-c3fee160e959 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:27.252264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:27.258067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:27.357969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2896-7372-4ae6-8266-4ad890072223 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:27.390082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:27.390687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:27.390967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:27.391240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:27.391894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:27.393322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939f30-16da-45d8-a30a-67bf375e2dee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:27.418107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Sep 29 01:57:27 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:29.649867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278835-e997-4cad-88d1-92ef4430385b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:29.650377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278835-e997-4cad-88d1-92ef4430385b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:29.650461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278835-e997-4cad-88d1-92ef4430385b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:29.651757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:29.657011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:29.657411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:29.657603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:29.676184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:29.678284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:29.688483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:29.744459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:30.015647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278835-e997-4cad-88d1-92ef4430385b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:30.116091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278835-e997-4cad-88d1-92ef4430385b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:30.125083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:30.150052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:30.150678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:30.150961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:30.151233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:30.152340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:30.153808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657f4ad-0055-49b9-8c37-b2e2b8e6f517 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:30.155355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:30.161032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:30.257685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0abe-4ad6-43bd-8ab0-938323bf9108 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:30.290089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:30.290632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:30.290919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:30.291198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:30.291858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:30.293318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3337c-2280-48c5-b7c6-92c5046c495e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:30.319971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:30 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:33.625088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447ae7-ea7e-4511-b135-491145ed9770 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.625996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447ae7-ea7e-4511-b135-491145ed9770 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.626424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447ae7-ea7e-4511-b135-491145ed9770 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.627933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:33.633619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2685-4f41-4244-90f9-c7728b2c9aea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.634069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2685-4f41-4244-90f9-c7728b2c9aea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.634374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2685-4f41-4244-90f9-c7728b2c9aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.645428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.659150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e64b2685-4f41-4244-90f9-c7728b2c9aea None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:33.660054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dc078-7d68-4d1c-961c-bcbecd29063e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.661165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dc078-7d68-4d1c-961c-bcbecd29063e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.661957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dc078-7d68-4d1c-961c-bcbecd29063e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.662577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e64b2685-4f41-4244-90f9-c7728b2c9aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:33.663096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:33.670342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4f5e-b8fa-49b1-aa5b-8d5a982498d3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.670906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4f5e-b8fa-49b1-aa5b-8d5a982498d3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.671379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4f5e-b8fa-49b1-aa5b-8d5a982498d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.696093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9d5c4f5e-b8fa-49b1-aa5b-8d5a982498d3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:33.697292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d5c4f5e-b8fa-49b1-aa5b-8d5a982498d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:33.785296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:33.811719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:34.039270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89a6-e258-48aa-8629-8e2323b2848a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.039525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89a6-e258-48aa-8629-8e2323b2848a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.039787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c89a6-e258-48aa-8629-8e2323b2848a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.041162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:34.047218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b11f-94f3-4268-806f-0d52f4f58118 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.047505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b11f-94f3-4268-806f-0d52f4f58118 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.047774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b11f-94f3-4268-806f-0d52f4f58118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.069526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-eea1b11f-94f3-4268-806f-0d52f4f58118 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:34.070833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-eea1b11f-94f3-4268-806f-0d52f4f58118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:34.090276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c89a6-e258-48aa-8629-8e2323b2848a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.179941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:34.183280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c213-e0ac-474c-9936-76d097770eb6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.183740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c213-e0ac-474c-9936-76d097770eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.184191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c213-e0ac-474c-9936-76d097770eb6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.185870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 35/68] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:34.190833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.191281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.192243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.227498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:34.228952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:34.272821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c89a6-e258-48aa-8629-8e2323b2848a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.283823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.312008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.316044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.316897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.317219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.317667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.331182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:34.331765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:34.332529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:34.339270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:34.340283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:34.341043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:34.343513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 34/70] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:34.349928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.466484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439843-7924-4fb6-9d38-d5a17fd06ffb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.497656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6fbe-200c-4288-a4ae-b7e31240a883 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.503524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.504188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.504829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.504829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.515193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-edbebe3e-805d-4f87-8447-149a56eb6476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:34.520741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:34.521603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:34.522560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 37/71] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:34.528327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f0ec-d807-4038-b817-5e4f03f6ef0d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.528630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f0ec-d807-4038-b817-5e4f03f6ef0d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.528909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f0ec-d807-4038-b817-5e4f03f6ef0d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.530207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 38/72] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:34.530898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f0ec-d807-4038-b817-5e4f03f6ef0d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.542176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.542802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.543198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.543467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.544198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:34.544621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.546100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.561237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 35/73] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:34.561237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.564915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.622118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.648837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f0ec-d807-4038-b817-5e4f03f6ef0d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.665791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80f46-0233-406c-b2a8-65a5664eb095 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.683331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.683961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.684245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.684517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.695110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:34.699544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b84d03f4-ce5e-41d1-bd8a-54e3738172d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:34.699934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:34.700899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:34.701786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:34.702571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.702571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.702571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.702741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:34.702803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:34.702803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.703073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.706836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.707193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.707511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.711321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.712116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.730408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:34.731613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:34.796514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 40/76] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:34.797171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.810491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322d56a-86a5-410f-ba13-2f5bd272f598 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.827033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.838893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.845655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.846346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.846634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.846910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.861744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.863192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.865060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 37/77] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.865849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.938021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590bbd-ba4e-4ee2-90d1-c0c92ad3cfa2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.974047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.974682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.974974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.975256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.976392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.977875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.979705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 41/78] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.980222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.986884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04dddb-bc33-448d-8a27-d979499a3782 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.023572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.024419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.024845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.025283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.026136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:35.026442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.027813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.037658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 38/79] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.038490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.074474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.078584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.091300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429bf94-8aa3-4a40-a594-2caf8a45455f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.127357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.127999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.128284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.128560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.129763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.131224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.132791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 42/80] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.133540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.145605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdf7d-19cb-4e33-86ec-88514812f055 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.179298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.179906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.180185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.180457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.233879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38eb5-d2ab-4543-857a-ed701ab4aa9e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.247121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.248596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.267745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.268357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.268642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.268924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.269610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.271577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.281312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.298130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 43/81] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:35 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:35.298953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.310551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.359713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 39/82] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:35.359713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.430177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e01ca-cb39-4e33-81d7-410a0ca38b12 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.468597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.469253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.469658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.469905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.471014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.472500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.474995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.476275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.484854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038713fc-374b-4bbf-a186-fd041cb140f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.523346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.523997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.524285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.524562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.528437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.542187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:35.547288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:35.548302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 40/84] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:35.549192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.565468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.599814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573a01-4023-4709-b2bc-66a04c5afc51 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.640033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.640033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.640033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.640372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.686565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62355287-9cc3-4fc3-b32e-da6270427782 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.727142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.728660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.730377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.731244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.731741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.732210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.733600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.735256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.737093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 41/85] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.738086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.811569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.839404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.855488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad203ad-63bd-430f-86a2-6e67bc831748 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.873251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 45/86] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:35.874275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.899030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.899578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.899868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.900149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.991833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84badd88-07f3-4496-9919-7d4a4c97f8e7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.992844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.994669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.036076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.036687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.036963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.037235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.037926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.038229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.039624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.049150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 46/87] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.050033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.081616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.096628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.137423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 42/88] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:36.139421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.173311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd51d-1c92-4e9b-bbb5-506d005b4ec2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.219997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.220466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.220847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.221224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.222134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=5cf91871099347a1a436250895505724) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.222568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.224955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.231701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 47/89] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=a7ea816836af4541b645f88001cb4469 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.238225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.292460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d9f6-c015-47a3-aa95-89b34429ef75 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.370561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.372475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.372769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.373051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.377148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.378731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.381415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 43/90] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.382316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.433918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.441038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c65dd-536b-4e0c-ad2d-2abcddbd8b06 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.450756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.511770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20e711-91c2-416d-b844-c679ea0dea40 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.521796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.522692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.522998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.523279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.526076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.527547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.529300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 48/91] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.530091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.582708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.583364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.583651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.583927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.586238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.587724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.589687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 44/92] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.590460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.686025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d203-db2f-4b1c-b565-ec128e250ba9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.760664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.761277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.761579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.761855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.762596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=1d9dd2adfb054acebc7de33da50790a5) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.762908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.764378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.770996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 49/93] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/role_assignments?user.id=1d9dd2adfb054acebc7de33da50790a5&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.771804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.794968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.803990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee513d3-5851-4b05-841b-b71220e52321 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.869121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.906245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.906887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.907173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.907456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.916591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf95e3-d21e-49ef-b180-5999f87f168e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.958057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.959653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.960188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.960658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.961697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=5cf91871099347a1a436250895505724) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.962240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.969550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.981626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:37.064352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:37.065871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:37.181837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:37.185990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:37.187684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:37.297853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:37.302406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d945-b73d-4ce4-8f86-72a72c977aec None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:37.349796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:37.350448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.350726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.350998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] PATH_INFO: `/v3/projects/d97dc874d1cc469f8f155776ad6584e3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.354238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] RBAC: Authorizing `identity:get_project(project_id=d97dc874d1cc469f8f155776ad6584e3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:37.355718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758638e9-4882-42ab-ac94-399f1323cea9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:37.357742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:37 2022] GET /identity/v3/projects/d97dc874d1cc469f8f155776ad6584e3 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:37.363629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:37.507669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d09e-2c3b-4410-a2a4-7b04e35ddb69 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:37.552212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:37.552893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.553178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.553448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.554216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=d97dc874d1cc469f8f155776ad6584e3, user.id=5cf91871099347a1a436250895505724) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:37.554522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:37.555961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03217f-ec27-4f96-89ac-1c8c9904deff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:37.561615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:37 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=d97dc874d1cc469f8f155776ad6584e3&role.id=a7ea816836af4541b645f88001cb4469 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:38.219937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6d13-288a-498a-a03b-3acfad50193d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.220965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6d13-288a-498a-a03b-3acfad50193d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.221444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6d13-288a-498a-a03b-3acfad50193d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.223593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:38.229136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d7e2-2eb8-41d4-acfa-8b25b994790a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.229966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d7e2-2eb8-41d4-acfa-8b25b994790a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.230448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d7e2-2eb8-41d4-acfa-8b25b994790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.249864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c852d7e2-2eb8-41d4-acfa-8b25b994790a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:38.251367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c852d7e2-2eb8-41d4-acfa-8b25b994790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:38.325536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.335042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:38.678793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c8c82-a369-4e86-a059-fe45141a70e6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.679494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c8c82-a369-4e86-a059-fe45141a70e6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.679971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c8c82-a369-4e86-a059-fe45141a70e6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.681529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 53/100] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:38.686815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.687312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.687797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.716123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:38.717647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:38.735978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c8c82-a369-4e86-a059-fe45141a70e6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.791432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 48/101] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:38.888670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c8c82-a369-4e86-a059-fe45141a70e6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.934172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.935132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.935614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.936092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.941142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:38.943540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:38.945432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 54/102] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:38.951126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.059755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e31cb-1741-4a12-bd0a-f446a2ccbe86 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.085086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.105537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.105537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.105537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.105537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.105861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:39.106353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.146577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 49/103] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:38 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:39.350806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.397858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.481996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6e27-9f1d-4f22-969a-a774afa99aed None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.526419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.527354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.527773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.528185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.540621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8c331529-9b05-41b8-a3ce-db508e058ea9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:39.545879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:39.546982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:39.547920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:39.550085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 55/104] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:39.556451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.679450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d4fe-f93f-4bce-8bfc-08e1320f7d5d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.683391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34ec5-e3b8-47f1-9269-3f121544ec50 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.683694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34ec5-e3b8-47f1-9269-3f121544ec50 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.683972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34ec5-e3b8-47f1-9269-3f121544ec50 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.686220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 56/105] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:39.695105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d9c7-627f-4682-a6ab-0c5dcfbcf828 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.695592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d9c7-627f-4682-a6ab-0c5dcfbcf828 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.696014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d9c7-627f-4682-a6ab-0c5dcfbcf828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.727582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3bc8d9c7-627f-4682-a6ab-0c5dcfbcf828 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:39.729994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3bc8d9c7-627f-4682-a6ab-0c5dcfbcf828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:39.756889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.757769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.758228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.758648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.759470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:39.759943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:39.761651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.783036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 50/106] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:39.789322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.863506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.874076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 57/107] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:39.951362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7562a-9665-4bce-912d-2f5eb5cd31cd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.978090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572b3f-35e3-4779-8483-8312a2d4977a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.978402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572b3f-35e3-4779-8483-8312a2d4977a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.978683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572b3f-35e3-4779-8483-8312a2d4977a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.980044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 58/108] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:39.986621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519901-a189-4734-a23d-e3200f264745 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.986910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519901-a189-4734-a23d-e3200f264745 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.987189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519901-a189-4734-a23d-e3200f264745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.000973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.001927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.002209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.002669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] PATH_INFO: `/v3/users/2c5ce51e9bc345fca1d0adcbe547d479` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.011147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b4519901-a189-4734-a23d-e3200f264745 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:40.014755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b4519901-a189-4734-a23d-e3200f264745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:40.033435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5ce51e9bc345fca1d0adcbe547d479)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.034938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.037570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 51/109] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/users/2c5ce51e9bc345fca1d0adcbe547d479 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:40.044760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.057865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.169476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 59/110] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:40.211252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.218062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab3fa-efbd-4714-ad34-2f01626612f8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.257813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.258437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.258724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.259001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.291198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d066bd-9b47-4b9b-8d57-b4954a7d4f39 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.291499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d066bd-9b47-4b9b-8d57-b4954a7d4f39 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.291756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d066bd-9b47-4b9b-8d57-b4954a7d4f39 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.293095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 60/111] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:40.298382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df421-1005-4b73-968c-958878d53972 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.298673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df421-1005-4b73-968c-958878d53972 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.298942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df421-1005-4b73-968c-958878d53972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.326667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-478df421-1005-4b73-968c-958878d53972 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:40.329257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-478df421-1005-4b73-968c-958878d53972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:40.356819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.359830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.466176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.472363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 52/112] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:40.473712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.475569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 61/113] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:40.482477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df421-1005-4b73-968c-958878d53972 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.627183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.632822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776de80-a94b-4edd-a51f-e803ff45b793 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.647250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df421-1005-4b73-968c-958878d53972 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.688282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.688951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.689244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.689516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.696839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.697487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.697856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.698134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.700148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.701640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.703275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 62/114] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:40.709140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.711627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:40.719906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:40.720753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:40.721558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 53/115] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:40.726445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.789823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.838464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260db9f-6dd2-465e-86c5-1183d550265e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.845455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90924e6-8af8-4ecc-b05f-537212285db3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.878780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.879933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.880218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.880499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.881223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=2c5ce51e9bc345fca1d0adcbe547d479) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:40.881551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.882994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.885490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.886158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.886443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.886776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.888869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 54/116] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/role_assignments?user.id=2c5ce51e9bc345fca1d0adcbe547d479&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=12226f7583b9470e849e9882fa9bb52b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.890171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.903969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-28c933f4-7943-4afc-9684-da6e3f6518c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:40.909478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:40.910509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:40.911262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:40.912098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 63/117] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:40.915927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bd46-508e-43b1-b922-5b64f192582c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.915927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bd46-508e-43b1-b922-5b64f192582c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.915927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37bd46-508e-43b1-b922-5b64f192582c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.919066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 64/118] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:40.919747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37bd46-508e-43b1-b922-5b64f192582c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.944491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.041092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ad1e-116a-4391-9286-05d17bdd6364 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.046709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37bd46-508e-43b1-b922-5b64f192582c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.066134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.089882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.090545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.090833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.090926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.091120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.091534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.091816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.091905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:41.092084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.092172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.093535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.107017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 55/119] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.108010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.115476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f05d3a76-a075-4ce1-a5a8-361688b186fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:41.122561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:41.123393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:41.124139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:41.127083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 65/120] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:41.129934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.130847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.131321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.156414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:41.158367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:41.218674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce2d9-ccd2-43fa-aefc-3ac8a9339dc1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.249348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 66/121] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:41.250336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.252824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.260300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.261021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.261371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.261796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.262554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:41.262923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.264628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.274335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 56/122] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.282644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.381541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.390571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7728af-3285-4ee5-929e-6cd34f265fad None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.456618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.457292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.457646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.457931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.459258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.462502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.463614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 67/123] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.464410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.478018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4927b1-995a-4870-8fcd-ccebc096798d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.542674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.543583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.544040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.544486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.545324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:41.545843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.547409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.563164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 57/124] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.565802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.587501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.620522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c42c-1f29-4e72-88fd-235ca17bbe8a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.655848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.656840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.657321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.657820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.659226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.661424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.663231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 68/125] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.664168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.697011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ef3e-a9ca-4529-b66e-e2b5c9759bd5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.714001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.735911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.736741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.737219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.737660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.739511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.741143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.742994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 58/126] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.743971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.770200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59571c-f7e7-48fd-a87a-90e917a9e944 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.805022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.805713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.806000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.806276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.807432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.808902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.810510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 69/127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.811268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.821955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.868626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0263d-6038-4ea1-a1df-89892c523524 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.911649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.913319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.913823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.914270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.921415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4fd9-b489-4ea6-a416-fb7c6c9d8738 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.929216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:41.936275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:41.937094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:41.937900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:41.944736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 59/128] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:41.944736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.977690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.978368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.978651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.978928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.980068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.981641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.983567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 70/129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.984329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.985906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.058387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771f9a-4393-4407-b3b0-526f09dde9b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.091705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.104090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.105523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.106340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.107022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/5cf91871099347a1a436250895505724/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.109454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, user_id=5cf91871099347a1a436250895505724, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.111771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.129421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 60/130] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:41 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/5cf91871099347a1a436250895505724/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:42.130018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf2a6-b829-4cf1-84c0-deecbb6314d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.130986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:42.176432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.177057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.177345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.177849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.180151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.181737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.183757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 71/131] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:42.184374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:42.290193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.301755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070ee2-dac9-4181-9256-172581eac1c8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.302713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e1fd-85e1-40fd-a9ea-baef363e1c85 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.350221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.350418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.350666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.350847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.351523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:42.351838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.353229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.353759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.354847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.355335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.356214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/1d9dd2adfb054acebc7de33da50790a5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.358523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, user_id=1d9dd2adfb054acebc7de33da50790a5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.360982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6afbc-f2d5-4ad7-92f7-178de6d11f65 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.362444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 61/132] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:42.363251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:42.380981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 72/133] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:42 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/1d9dd2adfb054acebc7de33da50790a5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:42.382413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f2a-356c-466f-8029-45bb9f2e0a1a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.382706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f2a-356c-466f-8029-45bb9f2e0a1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.382980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f2a-356c-466f-8029-45bb9f2e0a1a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.384411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 73/134] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:42.389293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f2a-356c-466f-8029-45bb9f2e0a1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:42.392622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.535249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce899872-9230-4fb3-bc18-51058dbc6449 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.583281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f2a-356c-466f-8029-45bb9f2e0a1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.613038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.614766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.615252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.615761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/5cf91871099347a1a436250895505724/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.618309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, user_id=5cf91871099347a1a436250895505724, role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.619969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90117a-3c53-418c-a0b2-ad10ca286176 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.642605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 62/135] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:42 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/5cf91871099347a1a436250895505724/roles/ec1eab75eebd4484b004466d3dede7cb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:42.644013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.644305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.645098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.656051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.656728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.657051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.657261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.659418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.661143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.662875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 74/136] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:42 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:42.669372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:42.683689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:42.685127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:42.704224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.806425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.820593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 63/137] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:42.860417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae051f9-0b42-4a24-9378-dedee7deff2b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:42.925299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:42.926056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.926341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.926617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] PATH_INFO: `/v3/projects/d97dc874d1cc469f8f155776ad6584e3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.930777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] RBAC: Authorizing `identity:get_project(project_id=d97dc874d1cc469f8f155776ad6584e3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:42.932268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab0ce-1817-4ae0-beac-43d681fdc127 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:42.934062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 75/138] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:42 2022] GET /identity/v3/projects/d97dc874d1cc469f8f155776ad6584e3 => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:42.939928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.065317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0d93-ba27-400f-adf7-a23096526723 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.111464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.112132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.112468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.112743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] PATH_INFO: `/v3/projects/d97dc874d1cc469f8f155776ad6584e3/users/5cf91871099347a1a436250895505724/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.115468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] RBAC: Authorizing `identity:create_grant(project_id=d97dc874d1cc469f8f155776ad6584e3, user_id=5cf91871099347a1a436250895505724, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.117033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ebf5-0b3a-4724-96ab-37c2428d9d0b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.132754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 64/139] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:42 2022] PUT /identity/v3/projects/d97dc874d1cc469f8f155776ad6584e3/users/5cf91871099347a1a436250895505724/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:43.358861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e0a5-b02c-4cf4-8514-9454902a2c56 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.359151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e0a5-b02c-4cf4-8514-9454902a2c56 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.359427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e0a5-b02c-4cf4-8514-9454902a2c56 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.360834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 76/140] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:43.366951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.367310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.367589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.381944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.388735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:43.390814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:43.469633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 65/141] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:43.511405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e0a5-b02c-4cf4-8514-9454902a2c56 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.627778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e0a5-b02c-4cf4-8514-9454902a2c56 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.672456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.673212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.673447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.673741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.676976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.678507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.680086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 77/142] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:43.685749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.833565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112abb24-41bd-45bf-8a65-4ab80d45012b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.892185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.892724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.893011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.893293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.894007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.895605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.911360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.941482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 66/143] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:43 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:44.021387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:44.031799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:44.166456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90d686-e3ea-4651-9a6b-9c292a3b17f5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:44.216983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:44.218044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.218523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.218986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.236142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:44.243217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:44.244120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:44.244873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:44.251379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 78/144] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:44.262605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:44.400361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33276-33bc-425c-9e45-c97466b74651 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:44.435373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:44.435920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.436203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.436479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.437154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:44.437471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:44.438892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:44.453232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 67/145] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:44.455560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:44.584792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:44.659277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6732187-89f2-4053-8ac5-9f11ce531ba4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:44.721987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:44.724174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.724653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.725116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] PATH_INFO: `/v3/users/2c5ce51e9bc345fca1d0adcbe547d479` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.726508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5ce51e9bc345fca1d0adcbe547d479)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:44.728164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ceda0-0b8a-40e3-b909-a66a88e98a90 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:44.729960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 79/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:44 2022] GET /identity/v3/users/2c5ce51e9bc345fca1d0adcbe547d479 => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:44.739513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:44.866306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:44.971571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a01700-3c78-4910-a250-13a99b54f504 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.042357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00f2-cadf-4a19-a0df-f253e7f99baf None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.042637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00f2-cadf-4a19-a0df-f253e7f99baf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.042848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a00f2-cadf-4a19-a0df-f253e7f99baf None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.044184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 80/147] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:45.049310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.049618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.049824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.050203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.050688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.051739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.052225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.058609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:45.061248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:45.064477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 68/148] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:44 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:45.073243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:45.074464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:45.074647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.283567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 81/149] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:45.313408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2d5b9-31d7-4208-bb1f-58ce4f7e7e40 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.340954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.354919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.355607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.355893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.356176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/2c5ce51e9bc345fca1d0adcbe547d479/roles/12226f7583b9470e849e9882fa9bb52b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.359463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, user_id=2c5ce51e9bc345fca1d0adcbe547d479, role_id=12226f7583b9470e849e9882fa9bb52b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:45.362429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:45.387193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 69/150] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:45 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/users/2c5ce51e9bc345fca1d0adcbe547d479/roles/12226f7583b9470e849e9882fa9bb52b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:57:45.770590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.860179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.913060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9c53-2316-41e6-93be-973c9d28cbb1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.968859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.969541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.969848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.970123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.988412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-de16740a-65c4-4357-aa84-6ba597f1dfbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:45.993544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:45.994420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:45.995278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 82/151] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:46.006747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.103221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652fa6-3a7e-408d-8396-a8ed6d86b9d7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.103515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652fa6-3a7e-408d-8396-a8ed6d86b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.103793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652fa6-3a7e-408d-8396-a8ed6d86b9d7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.110473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 83/152] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:46.117888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.118310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.118586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.154448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327e40f-c75a-4ce3-b6c1-08b22a7be682 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.156814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:46.158044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:46.220454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.221082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.221366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.221678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.222394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:46.222690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.224077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.240878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 70/153] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:46.248320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.304000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 84/154] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:46.311244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.371445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2342f8-8028-4b5d-902b-5f72224b9569 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.406962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.407948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.408458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.408931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.410445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.412772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723b0ef-3302-4faf-989b-20ad2e3d25e1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.414856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 71/155] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:46.420643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.479833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea19-d0ff-46ac-bc8b-cf097930c2a3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.480475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea19-d0ff-46ac-bc8b-cf097930c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.480972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea19-d0ff-46ac-bc8b-cf097930c2a3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.482602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 72/156] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:46.488974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.489798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.490297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.494726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.525800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:46.527016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:46.559740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030c27c-ff8f-4893-838b-f60a1f776227 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.623139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.623678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.623966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.624238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.670981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 73/157] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:46.728561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.734451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baacc70-e045-40d9-ae21-8231b0d5e117 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.832277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.891043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 85/158] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:46.897171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.922491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b0bd-2a5e-4f97-b6b2-4cee3c54ede2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.923250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b0bd-2a5e-4f97-b6b2-4cee3c54ede2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.923731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b0bd-2a5e-4f97-b6b2-4cee3c54ede2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.925899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 86/159] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:46.931508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.932044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.932648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.958859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:46.960822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:46.989180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.076579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 87/160] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:47.077791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.116508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36de22-3d60-45f6-bdec-d30279b0f8b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.188795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.189371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.189676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.189954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.192437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.194292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.195961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 74/161] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.202756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.232194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.258206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e461a-72ba-487e-9729-7a36e3cfeebf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.319148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.319832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.320109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.320430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.338688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:47.344536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:47.345395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:47.346612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 88/162] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:47.352727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.403530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9cbbc-4aed-4a02-bfad-e4f2722b5e86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.421869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.452468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.453042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.453319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.453837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.454578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=5cf91871099347a1a436250895505724) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:47.454882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.456327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.464643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 75/163] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=a7ea816836af4541b645f88001cb4469 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:47.465449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.591638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13d2d-5b10-46fc-8fe3-462d5551e62f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.624574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860570f-31a3-48a5-aee9-952ea25f29be None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.674162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.674944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.675225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.675496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.686961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.687598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.687886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.688129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:47.688240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.688830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:47.689135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:47.694611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:47.695489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:47.696673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:47.697730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.697802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 76/164] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:47.706824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.708782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 89/165] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.718593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.753980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.770146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.855728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf622-03d9-4e8b-8c1c-820a9bd12374 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.915384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.916001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.916280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.916552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.917520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:47.917520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.918908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.931488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 77/166] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.932325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.944667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e18f-2b0f-49f1-8f2f-dd1107f57bf3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.990624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.992046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.993899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.995176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] PATH_INFO: `/v3/users/1d9dd2adfb054acebc7de33da50790a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.999263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] RBAC: Authorizing `identity:get_user(user_id=1d9dd2adfb054acebc7de33da50790a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.000937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.003047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 90/167] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/users/1d9dd2adfb054acebc7de33da50790a5 => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.005813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.105722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.117869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970749d0-3791-4003-8303-43f8c1f3b548 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.170737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.193490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.194155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.194440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.194715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.213546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:48.218865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:48.219806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:48.220586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 78/168] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:48.221278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.224921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577d20-0e5a-42e9-a2a7-286d96a5dedd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.306310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.306888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.307174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.307457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.308650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.310176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.311961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 91/169] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.312503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.358660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ae9b-a2a4-4c80-bfc7-76aa6279f027 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.447607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.448559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.449032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.449556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.523453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.567456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a125b6-406f-4a1d-a329-a84be794d5b6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.638251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.638882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.639154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.639497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.640098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:48.640401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.641823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.664503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 92/170] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.665437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.672744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.682037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.683527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.961481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb967cc-3f2c-47b1-a506-eb0939395a46 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.038188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 79/171] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:49.041994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.107016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.107679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.107971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.108345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.198003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.235548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.236941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e5c1-9230-45b3-82e4-c31778c61e3c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.242277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.278956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ffcad-9034-4d5e-8ab2-a29754681ace None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.336711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.337815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.338591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.339098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] PATH_INFO: `/v3/users/5cf91871099347a1a436250895505724` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.340618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cf91871099347a1a436250895505724)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.342309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.344815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 80/172] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/users/5cf91871099347a1a436250895505724 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.345815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.390486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 93/173] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:49.391585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852374d6-cc5c-4b45-90a1-7af96c011979 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.397685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852374d6-cc5c-4b45-90a1-7af96c011979 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.399886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852374d6-cc5c-4b45-90a1-7af96c011979 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.401425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 94/174] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:49.407039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5374c-dadf-4948-beab-ac2ce859a231 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.407463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5374c-dadf-4948-beab-ac2ce859a231 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.408143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5374c-dadf-4948-beab-ac2ce859a231 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.413311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 95/175] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:49.413311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5374c-dadf-4948-beab-ac2ce859a231 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.476811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c752-ee02-4dff-b835-03ef75d2cda9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.505722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.521742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.522895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.523382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.523881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.525416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.527293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.529916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 81/176] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.531034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.542767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5374c-dadf-4948-beab-ac2ce859a231 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.546169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.587411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.588793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.589193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.589718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.646594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458600-992b-4e28-86f6-6f1cd0fd604b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.674124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.675631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7a53-0492-4c02-a364-b61c38dad3dd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.683697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.684333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.684614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.684886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.686041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.687595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da166e9-2737-44a6-9aa4-1a9ab45825bd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.689221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 82/177] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.690432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.690715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.690984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.710041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:49.711607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:49.783281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.792256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 96/178] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:49.793496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9746-4076-4a95-a19b-19ef5f5ba9e9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.793811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9746-4076-4a95-a19b-19ef5f5ba9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.794085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9746-4076-4a95-a19b-19ef5f5ba9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.800568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 83/179] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:49.802010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.807056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.825944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-babe9746-4076-4a95-a19b-19ef5f5ba9e9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:49.827949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-babe9746-4076-4a95-a19b-19ef5f5ba9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:49.904792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 97/180] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:49.906355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de13ad-102d-4b6d-ba5d-78d05c68e146 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.906891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de13ad-102d-4b6d-ba5d-78d05c68e146 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.907354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de13ad-102d-4b6d-ba5d-78d05c68e146 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.908790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 98/181] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:49.909683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de13ad-102d-4b6d-ba5d-78d05c68e146 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.923001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910d286-80ce-4c37-98df-b5c0b0c7ac76 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.969248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.970530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.971040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.971600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.972725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=1d9dd2adfb054acebc7de33da50790a5) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:49.973272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.975243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.983070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 84/182] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/role_assignments?user.id=1d9dd2adfb054acebc7de33da50790a5&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.984126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.031591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de13ad-102d-4b6d-ba5d-78d05c68e146 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.056524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.069950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.070567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.070899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.071173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.071913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=5cf91871099347a1a436250895505724) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.072221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.074220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807883-7382-4622-9849-6b2668a85122 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.076089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.081353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 99/183] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.083363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c271-4aa3-48ea-9155-d37eeb1f1447 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.083661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c271-4aa3-48ea-9155-d37eeb1f1447 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.083941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3c271-4aa3-48ea-9155-d37eeb1f1447 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.085422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 100/184] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:50.086703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf661-f41c-494e-9a9c-4118385c8f27 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.087242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf661-f41c-494e-9a9c-4118385c8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.087718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf661-f41c-494e-9a9c-4118385c8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.114339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599591eb-92fd-448f-bf01-f2cfe2513097 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.142715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e30bf661-f41c-494e-9a9c-4118385c8f27 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:50.143986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e30bf661-f41c-494e-9a9c-4118385c8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:50.157704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.158367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.158704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.158984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] PATH_INFO: `/v3/projects/d97dc874d1cc469f8f155776ad6584e3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.160829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] RBAC: Authorizing `identity:get_project(project_id=d97dc874d1cc469f8f155776ad6584e3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.162382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.164169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 85/185] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/projects/d97dc874d1cc469f8f155776ad6584e3 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.165211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.296993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41181fd-5dba-441d-ac31-2fe5b2c38a1c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.309496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 101/186] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:50.311850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.312140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.312413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.326208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.337769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:50.339454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:50.340609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.341258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.341623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.341908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.355444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:50.363741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:50.365185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 86/187] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:50.366071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.434733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 102/188] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:50.435801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.486180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d3ab1-5a25-49a9-b03c-8074e220cf86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.517172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.533646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.534264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.534546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.534822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.536095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=d97dc874d1cc469f8f155776ad6584e3, user.id=5cf91871099347a1a436250895505724) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.536460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.538456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.546408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 87/189] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/role_assignments?user.id=5cf91871099347a1a436250895505724&scope.project.id=d97dc874d1cc469f8f155776ad6584e3&role.id=a7ea816836af4541b645f88001cb4469 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.547197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.610329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.625763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43a051-321f-4147-8534-5c5c2ffbda06 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.671208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.671869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.672307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.672583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.680133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d433-befb-49f8-bf18-3003deb241a2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.687833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:50.694883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:50.695805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:50.696596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 103/190] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:50.701611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.732008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.732812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.733099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.733369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.734183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.734489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.735896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.747169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 88/191] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.748000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.827101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ee0-82a2-43bc-a631-79a7b62b2d01 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.845693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.858295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e90fa-b932-4e36-9388-02715f8454c6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.862644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.863752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.864035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.864306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.867595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.874317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:50.879807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:50.880842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 104/192] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:50.881780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.894141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.894920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.895381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.895666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.896335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.896668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.898051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.905855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 89/193] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.907740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.981704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee80-4ec8-4d37-917b-c684946cf316 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.004952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ba86-d149-4d22-843d-3b53f9eea9d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.015709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.016337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.016618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.016893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.018026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.019521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.021240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 105/194] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.021240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.040238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.040870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.041143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.041414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.054916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.056358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.057965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 90/195] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.058844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.069891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.086284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.125524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603f623-8293-45bf-af45-6b97ccf8502b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.157895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.158484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.158762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.159033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.159314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f5fc-9f56-4acd-b872-879c66f18f91 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.159686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:51.160061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.161523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.169453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 106/196] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.174370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.193386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.194052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.194329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.194599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.195724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.197191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.198774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 91/197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.199526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.274779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0a9b-5b7b-427e-a1b7-f6618e84c975 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.283280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.293065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.299074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae92d-d93b-47ad-adf1-2b2a8fe72566 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.308512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.309200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.309488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.309793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.310444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.311898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.331010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 107/198] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:51 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:51.334456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.334971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.335594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.335875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.336146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.416474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.417915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.450445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10664c6-ba70-4164-9b9d-8a80c8a497b3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.488749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.489375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.489711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.489984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] PATH_INFO: `/v3/users/2c5ce51e9bc345fca1d0adcbe547d479` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.491184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] RBAC: Authorizing `identity:get_user(user_id=2c5ce51e9bc345fca1d0adcbe547d479)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.492660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.494483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 108/199] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/users/2c5ce51e9bc345fca1d0adcbe547d479 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.495066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.526699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.531978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.538747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 92/200] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:51.540025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.612931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57a1f-a752-45ec-a0a6-0bd2c178d95c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.660404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.660962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.661238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.661546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.665699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e285-243b-468d-8c12-56a08562f663 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.708750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.709311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.709613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.709892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.742647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.745539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.783784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.784854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.793732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.795518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.881671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 109/201] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:51.887198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.915263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 93/202] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:51.919943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:52.015659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244344f3-46f1-4ea1-bfa4-8488e467bf9e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.028113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:52.034999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ba38-a84a-43db-b550-c9df356cba91 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.060026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:52.067347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.068843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.069349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.069878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.071350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.073641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.076389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 110/203] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.076941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.077611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.077896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.078167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.078409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:52.079339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.081069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.087730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 94/204] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.087730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:52.208401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b5cf-7c55-4617-a701-fbfeeedfb62a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.209225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf74b4-e41c-45e3-bb6c-4201bb1a9202 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.250782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.251865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.251972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.252454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.252580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.252804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.253078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.253478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.254368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.254718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=e78158ee71cf43489752dbaa74edcbc2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:52.255199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.256042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.257007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.262685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 111/205] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:52 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.262685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:52.268007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 95/206] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:52 2022] GET /identity/v3/role_assignments?user.id=e78158ee71cf43489752dbaa74edcbc2&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.268855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:52.304843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:52.343606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:52.397198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e415c9-8c49-4f4b-a446-d97683a8da41 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.420388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d0173-7dff-4338-b665-acc2f9a28dee None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:52.446217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.447100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.448974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.449429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.450374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05, user.id=2c5ce51e9bc345fca1d0adcbe547d479) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:52.450921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.452765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3543-70ed-4c8a-94f5-38174fe14622 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.471825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 96/207] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:52 2022] GET /identity/v3/role_assignments?user.id=2c5ce51e9bc345fca1d0adcbe547d479&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=12226f7583b9470e849e9882fa9bb52b => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.489974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:52.490614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.490889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.491164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.491917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=e78158ee71cf43489752dbaa74edcbc2) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:52.492223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:52.493773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c920904-95b6-4654-b9b4-d91272c7fa68 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:52.500145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 112/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:52 2022] GET /identity/v3/role_assignments?user.id=e78158ee71cf43489752dbaa74edcbc2&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:53.761172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e985-5c4b-431a-82cb-b51d76873fc9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.761750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e985-5c4b-431a-82cb-b51d76873fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.761750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e985-5c4b-431a-82cb-b51d76873fc9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.763537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 97/209] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:53.769329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1cf05-2751-4a13-8f08-1eb47290068f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.770502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1cf05-2751-4a13-8f08-1eb47290068f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.770502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1cf05-2751-4a13-8f08-1eb47290068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.790943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8ee1cf05-2751-4a13-8f08-1eb47290068f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:53.792191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8ee1cf05-2751-4a13-8f08-1eb47290068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:53.865551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 113/210] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:53.893987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6699-c45b-4be3-994e-9583b91171d8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.894320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6699-c45b-4be3-994e-9583b91171d8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.894609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6699-c45b-4be3-994e-9583b91171d8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.896056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 98/211] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:53.901372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.901709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.901990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.921691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:53.922880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:53.984128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.996408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 114/212] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:54.139477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6699-c45b-4be3-994e-9583b91171d8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.237602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.248931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6699-c45b-4be3-994e-9583b91171d8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.274032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.285757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.286882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.287173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.287449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.306933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:54.312329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:54.313673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:54.315031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:54.318535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 99/213] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:54.319421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.409620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9eade-c3d3-4f04-9c13-11e43b6ae91f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.431225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb16a93-63c1-48f9-8b1a-720c1e7e242e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.447295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.447886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.448083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.448354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.449460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.451215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.458463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 115/214] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.459015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.477760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.479015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.479856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.480357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.481228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:54.481838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.484256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.496054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 100/215] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.502370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.524468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.531508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.580295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525abc5-7568-47e4-b742-6e495e8186a0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.626098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.626753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.627024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.627297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.627983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.629586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.656492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4dee1-b917-4d30-9c23-40e6861b26c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.662046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 116/216] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:54 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:54.697553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.698601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.699088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.699562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] PATH_INFO: `/v3/users/04154c9798354ab1a4c0c38dd5079f91` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.717314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=04154c9798354ab1a4c0c38dd5079f91)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.719222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64da34-346c-4015-9a1d-c21b68655bb3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.721731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 101/217] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/users/04154c9798354ab1a4c0c38dd5079f91 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.728602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.730883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed37-6aa5-4760-af35-040b614c26eb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.731173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed37-6aa5-4760-af35-040b614c26eb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.731452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed37-6aa5-4760-af35-040b614c26eb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.732970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 102/218] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:54.739610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8b0c-3fb9-44fa-a3bf-201c07c8f8a6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.739896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8b0c-3fb9-44fa-a3bf-201c07c8f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.740168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8b0c-3fb9-44fa-a3bf-201c07c8f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.762548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-891d8b0c-3fb9-44fa-a3bf-201c07c8f8a6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:54.763946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-891d8b0c-3fb9-44fa-a3bf-201c07c8f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:54.845220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 103/219] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:54.849673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55990e4-f72d-41e9-a4bd-3375f0a5f3d1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.849673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55990e4-f72d-41e9-a4bd-3375f0a5f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.849673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55990e4-f72d-41e9-a4bd-3375f0a5f3d1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.849673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 104/220] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:54.856165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.856165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.856165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.858558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8229f7-55ae-449a-b6a6-f0d3ea1510bd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.864476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.881459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:54.882730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:54.884546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.909346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.910831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.911243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.911713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.962865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 105/221] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:55.003451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.005969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.114057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 117/222] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:55.119824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.131925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.152300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.234167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb6c60-6d9b-43c1-b303-ab627efcec18 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.249869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e8b48-1663-431c-be9e-d1b86374849f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.270144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.275447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.276487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.277052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.277614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.279079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.280840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.283242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 106/223] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:55.284204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.292971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.293653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.293936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.294208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.305730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:55.310603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:55.311505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:55.312327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 118/224] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:55.312992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.400197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.419568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac7b-3dfa-4319-909c-50d5e3c36c13 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.429412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c4d5-78e2-4b51-9542-af8306ae2280 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.461484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.463521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.464221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.464782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.471680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.472989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.473798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.474516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.475331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=04154c9798354ab1a4c0c38dd5079f91) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:55.475728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.477551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.477977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:55.483474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 119/225] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/role_assignments?user.id=04154c9798354ab1a4c0c38dd5079f91&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=a7ea816836af4541b645f88001cb4469 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:55.484381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:55.485451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:55.486379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:55.487169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:55.489397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 107/226] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:55.502161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.603223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.687156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd1097-2b63-4533-bf1d-ee98b0ef3dae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.695027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2fbd2-684a-4c78-8a5c-826283222560 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.744107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.744649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.744930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.745202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.745905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:55.746208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.747586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.761538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.762158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.762436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.762707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.763378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:55.763683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.765072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.770547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 120/227] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:55.776369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.780261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.781966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 108/228] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:55.788158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.960313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519695-e016-4024-899f-4b53c15a9b59 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.996717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00f6a1-74cd-4bd9-b861-8e0f7fc3b676 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.999927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.000701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.001053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.001400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.002875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.005580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.009288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 121/229] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:56.015568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.052195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.073009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.073682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.073967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.074243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.077267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.078854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.081457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 109/230] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:56.087327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.148283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.211362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc915-22d9-4a28-8e91-9a53d3e6741b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:56.233159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f9e66-c9a3-4ddc-9be3-ffe836e7586a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:56.288022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.288589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.288870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.289143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.291567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.293014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.297065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 122/231] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:56 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:56.298240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.298888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.299170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.299506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.301801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.302807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.304263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.306112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 110/232] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:56 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:56.311420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.379561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.424628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced1809-e980-4e1a-b121-881784daed15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:56.460419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4ef07-7eba-4bfe-9d73-b7d21c9a6a37 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:56.462001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.462868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.463483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.463869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/users/e78158ee71cf43489752dbaa74edcbc2/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.466231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, user_id=e78158ee71cf43489752dbaa74edcbc2, role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.467797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfea08-0db5-427d-b3d8-5d2682f75b75 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.495138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 111/233] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:56 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/users/e78158ee71cf43489752dbaa74edcbc2/roles/ec1eab75eebd4484b004466d3dede7cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:56.515228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.515906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.516193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.516472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/users/e78158ee71cf43489752dbaa74edcbc2/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.518523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, user_id=e78158ee71cf43489752dbaa74edcbc2, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:56.520030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549330b8-3eee-40ee-bd28-912bcfde53c3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:56.541979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.547514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 123/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:56 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/users/e78158ee71cf43489752dbaa74edcbc2/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:57.554255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c37f9-9196-4442-a8ba-afee2e0eefc9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.554750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c37f9-9196-4442-a8ba-afee2e0eefc9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.554750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c37f9-9196-4442-a8ba-afee2e0eefc9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.556056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 112/235] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:57.561566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10db6-1473-44d0-815b-d4969d1b0ffd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.562019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10db6-1473-44d0-815b-d4969d1b0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.562204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10db6-1473-44d0-815b-d4969d1b0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.587594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-55a10db6-1473-44d0-815b-d4969d1b0ffd None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:57.589051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-55a10db6-1473-44d0-815b-d4969d1b0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:57.685605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 124/236] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:57.707792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac312-c7a4-409c-b9fb-042f2c3ec0a0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.708087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac312-c7a4-409c-b9fb-042f2c3ec0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.708368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac312-c7a4-409c-b9fb-042f2c3ec0a0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.709735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 113/237] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:57.716005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5732d-afcb-4e60-b77e-2f34a41b87cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.716294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5732d-afcb-4e60-b77e-2f34a41b87cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.716572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5732d-afcb-4e60-b77e-2f34a41b87cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.735163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-afc5732d-afcb-4e60-b77e-2f34a41b87cc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:57.736348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-afc5732d-afcb-4e60-b77e-2f34a41b87cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:57.830958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 125/238] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:58.156185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de257b-112f-4f1a-a23e-fc78ac9bb33b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.156504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de257b-112f-4f1a-a23e-fc78ac9bb33b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.156746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de257b-112f-4f1a-a23e-fc78ac9bb33b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.158343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 114/239] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:58.164444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.164741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.165015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.166454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de257b-112f-4f1a-a23e-fc78ac9bb33b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.196416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:58.197656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:58.260371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.278867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 126/240] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:58.279700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.294870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de257b-112f-4f1a-a23e-fc78ac9bb33b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.313919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.337067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.338069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.338798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.339280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.341072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.342912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.345105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 115/241] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.350740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.451172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caf143-9e7d-453a-8555-d7b1670cd222 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.519631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.521677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.522591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.523972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.541219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f7ca6-a257-4aed-8a1d-de5fa78b644e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.550969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:58.556068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:58.556953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:57:58.558360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 127/242] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:58.562821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.588525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.590961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.592959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.593479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.594352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.596170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.629917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 116/243] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:58 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:57:58.630823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.642490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.699402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.747662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc2ed7-8d65-454f-bb13-8df2537e314d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.767028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2109cf-2a2b-4d91-89b9-97881ecc842e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.807873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.809119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.809383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.809690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.822387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:58.827266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:58.828014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:58.828876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:57:58.830098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 117/244] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:58.831365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.832493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.833046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.835730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.836444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:58.836942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.839082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.856003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 128/245] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.862279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.994014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97459363-c9fd-48ff-aa57-77a24d274394 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.997498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.043223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.044434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.044893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.045336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.045989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477950c-04d3-48e3-b885-b19e1290d705 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.046430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:59.046938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.048840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.059869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.061402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 118/246] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:59.072216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.106098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.106829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.107129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.107702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] PATH_INFO: `/v3/users/6a5a5010abf34369a23dbac750448fb3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.126069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] RBAC: Authorizing `identity:get_user(user_id=6a5a5010abf34369a23dbac750448fb3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.127873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9157cd-cff9-4a2c-9195-64339470fc7a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.130085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 129/247] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/users/6a5a5010abf34369a23dbac750448fb3 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:59.131306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fe00-4681-4056-8bee-e9c61df2dea2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.133112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fe00-4681-4056-8bee-e9c61df2dea2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.133677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fe00-4681-4056-8bee-e9c61df2dea2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.135071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 130/248] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:59.135655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fe00-4681-4056-8bee-e9c61df2dea2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.226223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ba767-79df-44a4-b8f8-129ba9f9110f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.267642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fe00-4681-4056-8bee-e9c61df2dea2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.271407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.271577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.271786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.272061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] PATH_INFO: `/v3/users/04154c9798354ab1a4c0c38dd5079f91` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.273250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=04154c9798354ab1a4c0c38dd5079f91)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.275514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c2b08-1b9c-45d6-87f2-4efc9320a5e6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.276596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 119/249] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/users/04154c9798354ab1a4c0c38dd5079f91 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:59.278173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70550245-cfde-4e1f-a57e-6130a174f271 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.278173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70550245-cfde-4e1f-a57e-6130a174f271 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.278363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70550245-cfde-4e1f-a57e-6130a174f271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.300638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-70550245-cfde-4e1f-a57e-6130a174f271 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:59.301250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70550245-cfde-4e1f-a57e-6130a174f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:59.324286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.325596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.326087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.326826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.329916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.376835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.381690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 120/250] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:59.382800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d75c-652a-410a-a475-3a798df6d67e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.383090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d75c-652a-410a-a475-3a798df6d67e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.383388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d75c-652a-410a-a475-3a798df6d67e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.384754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 121/251] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:59.389351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d75c-652a-410a-a475-3a798df6d67e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.491601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.493094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.514632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d75c-652a-410a-a475-3a798df6d67e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.557125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.558106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.558591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.559062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.560422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.562387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeeeb6-7981-4819-a08f-4fe96bab9986 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.564279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 122/252] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:59.566251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.566880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.567405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.588588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:59.590619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:59.625567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.692630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:59.694779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.709882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:59.711162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.790359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.823017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18e8d-cc48-44a2-b1d6-50f9706d53ac None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.860106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.861004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.861445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.861880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.863710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.865299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.867303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 124/255] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:59.868286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.871654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ce254-c6e7-447b-bf42-0c1c0b592b8b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.898222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.974809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.975490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.976061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.976061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/users/04154c9798354ab1a4c0c38dd5079f91/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.982778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, user_id=04154c9798354ab1a4c0c38dd5079f91, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.984225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.985385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb53e3-83f7-41df-891a-c12677b4df88 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.022727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.023652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.024088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.024496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.026722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 132/256] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:59 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/users/04154c9798354ab1a4c0c38dd5079f91/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:00.027617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.038906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:00.044366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:00.045544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:00.046527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:00.048629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 125/257] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:00.049747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.164196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.179004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ccd7b-8fde-478f-9e65-a1b8f6b6eb73 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.221614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.223351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.223958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.224373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.230136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df06-80b8-447d-80fc-81e25f60ac24 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.237279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:00.243767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:00.244896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:00.245857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:00.248685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 126/258] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:00.249695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.298695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.299325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.299601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.299883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.301450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=6a5a5010abf34369a23dbac750448fb3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:00.301712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.303177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.305824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.313973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 133/259] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/role_assignments?user.id=6a5a5010abf34369a23dbac750448fb3&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=12226f7583b9470e849e9882fa9bb52b => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:00.314825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.365819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732484-b7cf-40c3-891c-f8d0a6c5ca2d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.403560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.404235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.404520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.404782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.405458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:00.405788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.407184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.416217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 127/260] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:00.422031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.435702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.506094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c87937-d50a-42ea-be60-60faa4707e0c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.541817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c1c0-acb2-49c1-89eb-df649e8160b4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.579610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.580253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.580533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.580802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.582957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.584650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.586754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 128/261] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:00.592641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.626202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.626758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.627040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.627312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.627994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:00.628297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.629750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.655454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 134/262] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:00.666541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.682626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.703677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee3e2a-c870-4874-a403-8465405fd8fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.743773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.744551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.744831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.745102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.787562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.822599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.824173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.873013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acb36-fd5f-40dd-8915-0770b6d1c132 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.908553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.933679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 129/263] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:00.939758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.946203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.947054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.947481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.947897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] PATH_INFO: `/v3/users/e78158ee71cf43489752dbaa74edcbc2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.951070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=e78158ee71cf43489752dbaa74edcbc2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.952830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.955097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 135/264] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/users/e78158ee71cf43489752dbaa74edcbc2 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:00.961159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.057373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abab6e-daf3-45ed-a003-23039855537a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.100745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.101485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.101788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.102062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.106202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.107661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.109322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 130/265] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:01.117117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.220359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.258607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b2ca-9f7e-4fec-8974-f0531026c1f2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.283261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed95a-88e3-488f-b967-d07dc94c6d43 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.315053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.323843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.325084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.325597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.326064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.327013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=e78158ee71cf43489752dbaa74edcbc2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:01.327511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.329130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.336142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 131/266] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/role_assignments?user.id=e78158ee71cf43489752dbaa74edcbc2&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:01.355647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.356281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.356561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.356838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.457147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.458693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.587262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 136/267] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:01.592720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.730497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a5ed-b53e-46f3-9e2e-29f27add94de None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.753974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.785867 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.786956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.787414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.787859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.789611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.791309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcca88-d400-4f26-85d5-7c1246361fa5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.793454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 132/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:01.799712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.840650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.946800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f89342-47c6-4dcc-b415-4285a2cce81c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.985343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.985992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.986275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.986544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.987279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=e78158ee71cf43489752dbaa74edcbc2) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:01.987589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.989797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83183a30-8d40-4421-88d6-36735e32e9ea None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.001937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 137/269] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/role_assignments?user.id=e78158ee71cf43489752dbaa74edcbc2&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:02.189921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c3e7-1965-4eeb-bd78-eb8399cf8dc1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.190259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c3e7-1965-4eeb-bd78-eb8399cf8dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.190464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c3e7-1965-4eeb-bd78-eb8399cf8dc1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.193245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 133/270] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:02.207961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.208265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.208517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.230007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:02.231212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:02.271459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae959-aa26-419e-8994-03ae13e88bea None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.271787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae959-aa26-419e-8994-03ae13e88bea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.272022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae959-aa26-419e-8994-03ae13e88bea None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.273500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 134/271] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:02.280013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.280306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.281005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.301416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:02.302984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:02.342317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 138/272] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:02.384155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:02.624941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.643656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.689549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.767057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59b8b-5b52-40fc-b190-cfd6f0052c6e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.806875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.807500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.813541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.813541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.823917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:02.824190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4d78b-60ea-4eef-9e77-e7de08342998 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5d2893bd-c025-43d6-b5d4-1bf9cf786a7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:02.828800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:02.829962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:02.830750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 139/274] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:02.831538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4880f1-4a92-4990-8a6e-c364b7d28c5b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.831538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4880f1-4a92-4990-8a6e-c364b7d28c5b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.832358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4880f1-4a92-4990-8a6e-c364b7d28c5b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.834366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 140/275] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:02.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.839061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4880f1-4a92-4990-8a6e-c364b7d28c5b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.866298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.866937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.867219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.867492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.868605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.870103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191639c-d059-4a9d-a081-4e6dccfec485 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.871825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 136/276] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:02.872771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.873120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.873325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.891423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:02.892616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:02.918999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.943164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4880f1-4a92-4990-8a6e-c364b7d28c5b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.969569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:02.969569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.988557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.989288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.989655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.989982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.990656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:02.990961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.992943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.009700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 141/278] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:03.011813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.080543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47886-32d5-4e9b-95fd-4a0194c8d079 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.089977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.129126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.129741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.130027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.130301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.130969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.132606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.161616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949b4a-22be-4974-a8ab-d5b3109e5aee None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.163852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 138/279] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:02 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:03.209464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.210110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.210398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.210672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] PATH_INFO: `/v3/users/ff50792d945d4bc2ac098cf02d9452be` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.220649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.229010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] RBAC: Authorizing `identity:get_user(user_id=ff50792d945d4bc2ac098cf02d9452be)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.230603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.232494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 142/280] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/users/ff50792d945d4bc2ac098cf02d9452be => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:03.238834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.264394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.356817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719627e-cb6e-453e-b978-1451ca188b30 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.387326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348459ed-ec4a-4d92-999f-9f5b790afd01 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.396300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.396913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.397490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.397490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.398343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, user.id=ff50792d945d4bc2ac098cf02d9452be, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:03.398649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.400081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc6616-97f2-411a-b4a5-6ba76e2f00fa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.405361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 139/281] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/role_assignments?user.id=ff50792d945d4bc2ac098cf02d9452be&scope.system=all&role.id=a7ea816836af4541b645f88001cb4469 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:03.409714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310384-bb27-4bc6-8dec-01ba71dd28b8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.410342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310384-bb27-4bc6-8dec-01ba71dd28b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.410630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310384-bb27-4bc6-8dec-01ba71dd28b8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.412289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 140/282] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:03.418616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.419063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.419350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.431565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.431565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.431565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.431565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.443872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:03.443872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:03.452770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:03.459437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:03.460438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:03.461268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:03.461927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 143/283] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:03.472444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.474615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.539444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 141/284] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:03.550393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.603713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4181-c690-464c-ae1f-d2b540a71273 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.642659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.643274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.643549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.643821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.645427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:03.645924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.647307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.665128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 144/285] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:03.670673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.795623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ac31-e86f-4497-a77c-57ac5a90775e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.838001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.841698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.842564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.843035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.843546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] PATH_INFO: `/v3/users/04154c9798354ab1a4c0c38dd5079f91` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.845111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] RBAC: Authorizing `identity:get_user(user_id=04154c9798354ab1a4c0c38dd5079f91)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.846902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.849673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 142/286] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/users/04154c9798354ab1a4c0c38dd5079f91 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:03.855358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.881842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.971281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813a135-8cc1-4f14-a58d-f4aa32689af1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.983609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aa87c-c84f-46a3-8c9c-33c7120f08cb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.007343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.028053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.029166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.029454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.029754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.042883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:04.048270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:04.049169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:04.050005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 145/287] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:04.055701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.056126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.056818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.057292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.057800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.181283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.182776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.231180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.262064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b536d-1180-452e-94d3-458fe5da6503 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.334760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.335298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.335575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.335848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.336519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:04.336819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.338479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.360716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 146/288] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:04.364545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 143/289] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:04.367201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.371772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.452185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.517091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0cffd-bb00-4c4e-9780-6bd6bcfa6c69 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.544457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.562385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcb50b-be0d-4ca8-99db-b88ce6c53224 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.564499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.566435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.566921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.567559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.569711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.574959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.578079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 144/290] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:04 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:04.584198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.633427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.635199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.636588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.637220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] PATH_INFO: `/v3/users/6a5a5010abf34369a23dbac750448fb3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.639264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] RBAC: Authorizing `identity:get_user(user_id=6a5a5010abf34369a23dbac750448fb3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.641415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.651327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 147/291] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:04 2022] GET /identity/v3/users/6a5a5010abf34369a23dbac750448fb3 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:04.652332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.784353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e410-a53d-4ddf-a2c1-6e29706c21f3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.815135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899eaa-be3b-4ea5-94f1-193a54669445 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.834776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.861214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.863693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.865210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.865698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.866608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=04154c9798354ab1a4c0c38dd5079f91) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:04.867660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.869477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.882957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 145/292] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:04 2022] GET /identity/v3/role_assignments?user.id=04154c9798354ab1a4c0c38dd5079f91&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=a7ea816836af4541b645f88001cb4469 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:04.883880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.885084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.885632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.886126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.887578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.889340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b84f8-3001-4c75-92d8-0aa6ad6cf7f8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.891309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 148/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:04 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:04.898500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:04.962566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.012459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4054-8306-4762-88b2-35d3af765714 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.058525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.059556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.060016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.060469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/users/6a5a5010abf34369a23dbac750448fb3/roles/12226f7583b9470e849e9882fa9bb52b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.062644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, user_id=6a5a5010abf34369a23dbac750448fb3, role_id=12226f7583b9470e849e9882fa9bb52b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.064471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046694ba-c429-443d-b7d7-9627b6ca1045 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.087038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 146/294] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:04 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/users/6a5a5010abf34369a23dbac750448fb3/roles/12226f7583b9470e849e9882fa9bb52b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:05.833929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a53e1-fec3-4741-be36-28e500bf86be None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.834672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a53e1-fec3-4741-be36-28e500bf86be None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.835227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a53e1-fec3-4741-be36-28e500bf86be None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.836879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 149/295] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:05.843180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4a04-cf14-4bc2-859c-da1d6a7eb48f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.843514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4a04-cf14-4bc2-859c-da1d6a7eb48f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.843743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4a04-cf14-4bc2-859c-da1d6a7eb48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.864471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4a3d4a04-cf14-4bc2-859c-da1d6a7eb48f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:05.865744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4a3d4a04-cf14-4bc2-859c-da1d6a7eb48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:05.941552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 147/296] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:05.962862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50157a-2a16-4b8d-afa1-ba07843c1a7e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.963655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50157a-2a16-4b8d-afa1-ba07843c1a7e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.963655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50157a-2a16-4b8d-afa1-ba07843c1a7e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.965275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 150/297] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:05.971924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.972825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.973271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.992101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:05.993309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:06.032950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb59b-eecb-4201-8b24-ad446b89a93c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.033251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb59b-eecb-4201-8b24-ad446b89a93c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.033498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb59b-eecb-4201-8b24-ad446b89a93c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.035955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 151/298] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:06.037908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.041020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.041306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.041605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.067046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:06.067046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:06.067370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 148/299] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:06.139887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 152/300] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:06.249304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.349629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92644f83-d303-4ebc-b70a-0a84efa439f7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.369690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.384404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.385381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.385842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.386366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.398372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:06.404043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:06.405177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:06.406207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:06.413100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 149/301] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:06.414559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.452993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.478608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6e155-e119-426f-87d0-290dfd4c0667 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.486552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.514925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.515553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.515828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.516101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.526653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:06.531397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:06.532465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:06.533369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 153/302] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:06.534181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.536361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38402e-8842-4c57-b057-2db3d17fe49f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.576277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.576884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.577167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.577433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.578116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:06.578416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.579775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.588707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 150/303] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.589318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.644540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f09ea-9c93-4bc8-b52c-c041193c1c53 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.679738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.680448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.680738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.681011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.682137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.683613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.685168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 154/304] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.685969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.698401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.703020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b43b1f-c0c4-4923-b7e2-f1c145a8893f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.724477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.743179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.743799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.744084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.744359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.745029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:06.745497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.746950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.756281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 151/305] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.757064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.803505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621167d9-0b94-41b4-b1d7-d38b38ec455d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.838719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.839349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.839628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.839895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] PATH_INFO: `/v3/users/ff50792d945d4bc2ac098cf02d9452be` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.841023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] RBAC: Authorizing `identity:get_user(user_id=ff50792d945d4bc2ac098cf02d9452be)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.842507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.844067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 155/306] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/users/ff50792d945d4bc2ac098cf02d9452be => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.844815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.876853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d96641-3ee5-443c-b6cc-da9691775951 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.916211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.916778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.917066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.917341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] PATH_INFO: `/v3/groups` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.918003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.919443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.945540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 152/307] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Sep 29 01:58:06 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:06.945540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.971389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.975622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19cc77-a6d6-452c-be1d-1ef22940e427 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.988137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:07.030927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.031850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.032136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.032897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] PATH_INFO: `/v3/users/b62b4b497a624dce8de2700ae34f2195` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.052319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] RBAC: Authorizing `identity:get_user(user_id=b62b4b497a624dce8de2700ae34f2195)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.054443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.062130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 156/308] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/users/b62b4b497a624dce8de2700ae34f2195 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:07.063770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:07.090128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036edb-dab4-49ba-9c3e-4933298260e6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.137051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.138165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.138663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.138993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] PATH_INFO: `/v3/system/users/ff50792d945d4bc2ac098cf02d9452be/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.141787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff50792d945d4bc2ac098cf02d9452be, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.143249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de34b4-f9f7-4f1e-9dc2-4b7e573c4fd2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.156063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 153/309] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Sep 29 01:58:06 2022] PUT /identity/v3/system/users/ff50792d945d4bc2ac098cf02d9452be/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:07.209164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32445-09cd-4623-9fa5-20fdf4b0d679 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.252213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.252924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.253213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.254056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.254890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, user.id=b62b4b497a624dce8de2700ae34f2195, scope.system=all) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:07.255210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.256774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb90a7-1c04-4ed5-8a11-b393a75f588f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.263514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 157/310] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/role_assignments?user.id=b62b4b497a624dce8de2700ae34f2195&scope.system=all&role.id=12226f7583b9470e849e9882fa9bb52b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:07.384714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b165-4d1e-41ed-ae7b-89822d2610d1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.385041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b165-4d1e-41ed-ae7b-89822d2610d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.385273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b165-4d1e-41ed-ae7b-89822d2610d1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.387183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 154/311] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:07.392925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.393610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.394626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.415312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:07.416889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:07.437149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:07.489944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 158/312] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:07.757205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0b165-4d1e-41ed-ae7b-89822d2610d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:07.849399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:07.866634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0b165-4d1e-41ed-ae7b-89822d2610d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.902561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.903191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.903513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.903791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.915069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:07.920066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:07.920946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:07.921770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 155/313] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:07.930608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.036523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa521b-9d86-4dd0-afde-bc88c3791387 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.070946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.071560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.071839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.072110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.072780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:08.073083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.074528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.085624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 159/314] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:08.094059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.196062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71343174-7e16-4b60-97c0-88b69a70291d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.233604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.234240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.234520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.234792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] PATH_INFO: `/v3/users/6a5a5010abf34369a23dbac750448fb3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.235914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] RBAC: Authorizing `identity:get_user(user_id=6a5a5010abf34369a23dbac750448fb3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.237428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.239381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 156/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/users/6a5a5010abf34369a23dbac750448fb3 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:08.244969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.263935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.349673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fa74-7582-40a9-a9bb-bd87dd0cd797 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.385106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942179-d915-4640-9df7-207c16651248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.385756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942179-d915-4640-9df7-207c16651248 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.386037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942179-d915-4640-9df7-207c16651248 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.386313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942179-d915-4640-9df7-207c16651248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.456634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5942179-d915-4640-9df7-207c16651248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.458244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5942179-d915-4640-9df7-207c16651248 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.476584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.559711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 160/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:08.565051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.580219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.673820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be03a8-e098-4d88-b987-1cb03fd8e966 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.711293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.712332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.712805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.713577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.714960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.716603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e07be6-27bb-4f4c-ae51-7a236adc0fa4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.718859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 157/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:08.724936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942179-d915-4640-9df7-207c16651248 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.832288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942179-d915-4640-9df7-207c16651248 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.849952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.869479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.870491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.871019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.871488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.872407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, scope.project.id=92887987e56748fe85411bb09e82b246, user.id=6a5a5010abf34369a23dbac750448fb3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:08.872916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.874640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f37bd-a077-4703-a068-4ad86e5a08e1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.881833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 161/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/role_assignments?user.id=6a5a5010abf34369a23dbac750448fb3&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=12226f7583b9470e849e9882fa9bb52b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:09.342756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ce16-b48f-40c1-b44a-058717f52fd7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.343267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ce16-b48f-40c1-b44a-058717f52fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.343267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ce16-b48f-40c1-b44a-058717f52fd7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.344747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 158/319] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:09.350163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c9b2-32db-4d9f-8f3f-360841f428fc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.350551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c9b2-32db-4d9f-8f3f-360841f428fc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.350724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c9b2-32db-4d9f-8f3f-360841f428fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.369258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5264c9b2-32db-4d9f-8f3f-360841f428fc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:09.370467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5264c9b2-32db-4d9f-8f3f-360841f428fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:09.408671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0a2ed-75e0-4a5c-9e86-78c266c93a9f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.408996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0a2ed-75e0-4a5c-9e86-78c266c93a9f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.409228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0a2ed-75e0-4a5c-9e86-78c266c93a9f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.411225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 159/320] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:09.416143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626caf-5640-4181-aa87-639e31bd57ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.416432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626caf-5640-4181-aa87-639e31bd57ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.416705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626caf-5640-4181-aa87-639e31bd57ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.435747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e9626caf-5640-4181-aa87-639e31bd57ab None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:09.436943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e9626caf-5640-4181-aa87-639e31bd57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:09.440659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 162/321] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:09.505087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 160/322] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:09.612139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820bd0-d524-4b83-8cd7-8b0b12f1e657 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.612424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820bd0-d524-4b83-8cd7-8b0b12f1e657 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.613236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820bd0-d524-4b83-8cd7-8b0b12f1e657 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.615153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 163/323] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:09.620041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.620332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.620604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.638818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:09.639968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:09.642717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.709104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820bd0-d524-4b83-8cd7-8b0b12f1e657 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.713656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 161/324] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:09.774126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.812102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820bd0-d524-4b83-8cd7-8b0b12f1e657 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.822961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.847999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.848622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.848904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.849177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.850332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.851776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.853489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 164/325] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:09.858668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.881492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44da48-d9f2-4c60-9e90-bf4a40ab67b6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.917360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.918124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.918429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.918782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.926542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.931316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:09.936529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:09.937395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:09.943336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 162/326] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:09.944008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.965553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd104bbb-22cd-4e23-8ec1-9d4c42855a70 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.000361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.000973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.001244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.001524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] PATH_INFO: `/v3/groups` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.002176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.004440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.022545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 165/327] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Sep 29 01:58:09 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:58:10.023371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.049963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7164fb-06fa-4fbb-a476-d402cec69c30 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.070608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:10.089411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9e61-6430-4464-b06f-635900321198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.090059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9e61-6430-4464-b06f-635900321198 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.090337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9e61-6430-4464-b06f-635900321198 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.093778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9e61-6430-4464-b06f-635900321198 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.094525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba9e61-6430-4464-b06f-635900321198 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:10.094831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba9e61-6430-4464-b06f-635900321198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.096279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba9e61-6430-4464-b06f-635900321198 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.110039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 163/328] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:10.117128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9e61-6430-4464-b06f-635900321198 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.143524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220272-1d9d-4c08-b08b-4b475665063c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.187438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.187661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:10.188080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.188356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.188788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.202748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:10.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:10.208591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:10.209383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 166/329] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:10.216074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.241567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9e61-6430-4464-b06f-635900321198 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.289837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.290824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.290824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.291005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] PATH_INFO: `/v3/users/ff50792d945d4bc2ac098cf02d9452be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.292231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] RBAC: Authorizing `identity:get_user(user_id=ff50792d945d4bc2ac098cf02d9452be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.293734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.295370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 164/330] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:10 2022] GET /identity/v3/users/ff50792d945d4bc2ac098cf02d9452be => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:10.302836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.343222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:10.349822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b032a0-e66e-48b7-a141-ce74a8d438fe None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.399207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.400902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.401333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.401771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.402981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:10.403738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.405446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.416669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 167/331] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:10.422118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.431187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8085-21b8-49bd-84ec-99f4fc465048 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.475331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:10.482963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.483978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.484520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.484796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.485611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] RBAC: Adding query filter params (role.id=a7ea816836af4541b645f88001cb4469, user.id=ff50792d945d4bc2ac098cf02d9452be, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:10.485869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.487322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.502143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 165/332] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:10 2022] GET /identity/v3/role_assignments?user.id=ff50792d945d4bc2ac098cf02d9452be&scope.system=all&role.id=a7ea816836af4541b645f88001cb4469 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:10.549612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d7c4d-5d10-4b6a-883b-29e4605de4c6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.608120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.609230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.609745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.610281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] PATH_INFO: `/v3/users/b62b4b497a624dce8de2700ae34f2195` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.613639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] RBAC: Authorizing `identity:get_user(user_id=b62b4b497a624dce8de2700ae34f2195)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.615407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6bd9c-f7aa-420d-86bf-51e543f4208e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.617872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 168/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:10 2022] GET /identity/v3/users/b62b4b497a624dce8de2700ae34f2195 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:10.623220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:10.754116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a89d-6b15-45fe-805d-8c8d65028580 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:10.796548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:10.797213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:10.797498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:10.797795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] PATH_INFO: `/v3/system/users/b62b4b497a624dce8de2700ae34f2195/roles/12226f7583b9470e849e9882fa9bb52b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:10.800080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b62b4b497a624dce8de2700ae34f2195, role_id=12226f7583b9470e849e9882fa9bb52b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:10.801541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7509c-bbda-4d41-b4bf-3c45fcce9014 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:10.817623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 166/334] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Sep 29 01:58:10 2022] PUT /identity/v3/system/users/b62b4b497a624dce8de2700ae34f2195/roles/12226f7583b9470e849e9882fa9bb52b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:12.678205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623df3-f96b-48db-ae25-c02b8e780f3e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.679217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623df3-f96b-48db-ae25-c02b8e780f3e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.679725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623df3-f96b-48db-ae25-c02b8e780f3e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.681564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 169/335] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:12.687169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.688004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.688498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.713067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:12.714882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:12.777182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.800801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 167/336] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:13.085695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623df3-f96b-48db-ae25-c02b8e780f3e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.122418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.211064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623df3-f96b-48db-ae25-c02b8e780f3e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.256813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.257892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.258378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.258866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.272603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:13.277908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:13.278800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:13.279586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:13.282203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 170/337] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:13.289737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.402843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d590-76cc-4762-b025-430e5bab46e3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.440004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.441022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.441544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.442049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.442920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:13.443443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.445024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a93952-a439-41f6-ba40-4d7926163007 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.454503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 168/338] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:13.462840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.486016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92612-a91a-45e4-af1f-2de7b046518f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.486634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92612-a91a-45e4-af1f-2de7b046518f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.487192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f92612-a91a-45e4-af1f-2de7b046518f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.489368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 169/339] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:13.499201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93088a-5fa1-45da-82da-4cd5964e6e02 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.499765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93088a-5fa1-45da-82da-4cd5964e6e02 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.500241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93088a-5fa1-45da-82da-4cd5964e6e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.522137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3a93088a-5fa1-45da-82da-4cd5964e6e02 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:13.523679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a93088a-5fa1-45da-82da-4cd5964e6e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:13.585925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.631294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 170/340] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:13.640716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.661700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757aa6-ac8f-4e8d-b315-e68fbc944bce None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.717534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.718163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.718429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.718694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.810539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bb6a-73ce-4302-b90a-1b746e95df16 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.811553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bb6a-73ce-4302-b90a-1b746e95df16 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.812081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bb6a-73ce-4302-b90a-1b746e95df16 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.813801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 171/341] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:13.817617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.817824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.821924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.822387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.822849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.866555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:13.867786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:13.971859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.005636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 171/342] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:14.014967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.042758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 172/343] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:14.158341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b3f2b-8c47-4354-9471-1c71da40bded None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.201212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.201897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.202185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.202458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.203597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.205051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.208569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 172/344] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:14.213559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.224023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.307278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.365908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70300-d693-48a1-abb8-6830de360ae8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.371030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4680a7-b681-47a6-af32-47ed254ce341 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.373641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.411543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.412458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.412886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.413312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.422396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.423225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.423611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.423990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.427010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-cef2ae36-9084-4ae7-9c73-8f25d5d26850 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:14.432302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:14.433230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:14.436215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:14.438399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 173/345] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:14.438773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.440112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f7d8-e52a-4b1d-bc41-c5082684edf9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.440381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.441353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f7d8-e52a-4b1d-bc41-c5082684edf9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.441824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f7d8-e52a-4b1d-bc41-c5082684edf9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.442854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 173/346] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.448463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 174/347] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:14.448579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.450278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3f7d8-e52a-4b1d-bc41-c5082684edf9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.586370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3f7d8-e52a-4b1d-bc41-c5082684edf9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.606160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.610563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327f9ec-5678-4ddb-8401-ce4b767fdc9a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.638561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.639189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.639479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.639749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.640489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.640799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.642268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45114eb1-4249-4e4e-8180-5b9402a24c87 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.652886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 175/348] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.652886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c761075-7035-4491-bfff-4a4d1e056d16 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.652886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c761075-7035-4491-bfff-4a4d1e056d16 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.652886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c761075-7035-4491-bfff-4a4d1e056d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.664830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.665680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.666059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.666432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.667268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.668259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.670113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.673481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1c761075-7035-4491-bfff-4a4d1e056d16 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:14.674772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1c761075-7035-4491-bfff-4a4d1e056d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:14.681455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 174/349] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:14.682443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.731630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.781713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 176/350] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:14.783082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837a47-91e5-427a-bb3f-5d09923f6f4a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.783381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837a47-91e5-427a-bb3f-5d09923f6f4a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.783659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837a47-91e5-427a-bb3f-5d09923f6f4a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.785472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 177/351] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:14.786228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837a47-91e5-427a-bb3f-5d09923f6f4a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.834688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aee66-65a1-4d7c-8f07-9acb8ccd4f68 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.882420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.883123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.883407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.883679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.895524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b4750383-ee10-425a-829b-55804af406c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:14.900916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:14.901872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:14.902695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 175/352] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:14.903643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.903879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.904220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.922412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837a47-91e5-427a-bb3f-5d09923f6f4a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.927944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:14.929144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:14.935494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.968122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.968985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.969415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.969853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.007103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 176/353] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:15.007845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.045494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.053617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.055322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.157147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87636597-adde-4d05-9ee0-edb343127c28 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.170708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:15.178574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.191029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.202775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.203399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.203678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.203951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.204624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:15.204929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.206986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.217356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 177/355] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.218212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.342961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.364838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686acae-abe3-41d3-b5c2-2bbe3c39d948 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.383870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dca03-56c8-4c2f-ad4a-e9a68d9e0857 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.406793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.407487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.407719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.407997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.424382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:15.431973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:15.432901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:15.435173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:15.436514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.436678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 178/356] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:15.436806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.436806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.436806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.437172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.437302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.437302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a696ef-d812-4025-934f-33b4be32d453 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.441867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 179/357] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.443542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fa4a-19fa-44f4-b12c-b1474412abe1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.443912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fa4a-19fa-44f4-b12c-b1474412abe1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.444189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fa4a-19fa-44f4-b12c-b1474412abe1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.445488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 180/358] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:15.448692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9fa4a-19fa-44f4-b12c-b1474412abe1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.548193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.569742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5b3-2cd3-4737-8267-7cea77e086af None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.578254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9fa4a-19fa-44f4-b12c-b1474412abe1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.615208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.615928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.616278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.616657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.623141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.623760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.624037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.624310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.624977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:15.625283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.626738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.633560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.637468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 181/359] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.638316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.713954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.715407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e86807-7afb-4188-a9be-c6502620b333 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.780063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0dff2-84b8-44e2-978e-9695200d371e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.823819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.824484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.824760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.825222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.827462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.829077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.830684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 182/360] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.832047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.844015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.845186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 179/361] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:15.846995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.847632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.847990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.870466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:15.872230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:15.917484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.957186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 180/362] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:15.957938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.970968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3ec2-532a-4c24-aa70-4d2e47b3c7da None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.009224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.010402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.010930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.011440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.023750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:16.031702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:16.032649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:16.033453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:16.036781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 183/363] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:16.037954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.064364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace5c70-482c-4727-8c21-27dcc296b446 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.102652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.103300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.103581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.103853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] PATH_INFO: `/v3/users/b62b4b497a624dce8de2700ae34f2195` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.105155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] RBAC: Authorizing `identity:get_user(user_id=b62b4b497a624dce8de2700ae34f2195)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.106477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.108051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 181/364] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/users/b62b4b497a624dce8de2700ae34f2195 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.108811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.144529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.155004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.174396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef549fb-bc46-4a12-93ae-e003d588f640 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.225414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.226020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.226304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.226574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.227307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.227621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.229065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.231951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d52a9d-2888-4761-a3cd-6c308aa54537 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.235480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 184/365] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=a7ea816836af4541b645f88001cb4469 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.235480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.276313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.277426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.278003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.278865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.280304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.282162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.284418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 182/366] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.285757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.390895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549213-4c7e-4bfe-862f-475ac0b3fac5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.411899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc0783-f046-4fce-b118-1624ce62b20d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.423745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.433294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.439001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.439990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.440530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.441781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.442716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.443206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.444955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.456760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 185/367] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.457403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.458062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.458344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.458620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.458933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.459355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] RBAC: Adding query filter params (role.id=12226f7583b9470e849e9882fa9bb52b, user.id=b62b4b497a624dce8de2700ae34f2195, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.459674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.461232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.477455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 183/368] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/role_assignments?user.id=b62b4b497a624dce8de2700ae34f2195&scope.system=all&role.id=12226f7583b9470e849e9882fa9bb52b => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.478094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.604571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe791-f814-439e-87b9-3919ca83b001 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.647478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.648506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.648991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.649202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c8f22-96a5-430e-89f2-267bb90175d5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.649721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.669823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:16.680138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:16.681185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:16.682056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:16.684717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 186/369] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:16.685813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.731436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.732006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.732286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.732563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.733734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.735184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.736768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 184/370] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.737775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.781328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.796941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.874972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134ced-9d5a-4645-8206-5c2afa477501 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.881018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5569-255c-4738-a2a4-e8e85559b5d2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.920285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.920896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.921177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.921444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.934811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.935426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.935702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.935972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.936635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.936961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.938421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.950991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 185/371] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.950991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.026951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.031816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.076193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.083269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2922-c9ca-43d8-918e-fdabbac5a235 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.114279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.123895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.124509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.124797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.125069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.125834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=92887987e56748fe85411bb09e82b246) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:17.126146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.127957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.135153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 186/372] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=a7ea816836af4541b645f88001cb4469 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.135777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.184164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 187/373] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:17.189717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.334514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26acd-8f72-4784-b969-9338587a35cc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.400155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451430c-fe6b-4669-a03b-b0b277e0e977 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.404266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.404894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.405173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.405445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.440053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.441289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.441819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.441938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.442405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.443855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.445586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155823-8385-4e35-945c-5312e4f243a8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.447906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 188/374] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.449404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7747f-cef7-4a60-8ce4-3630b44cb9a8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.449924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7747f-cef7-4a60-8ce4-3630b44cb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.450446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7747f-cef7-4a60-8ce4-3630b44cb9a8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.451995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 189/375] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:17.457435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7747f-cef7-4a60-8ce4-3630b44cb9a8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.486151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.497789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.499533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.580388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7747f-cef7-4a60-8ce4-3630b44cb9a8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.621327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.622581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.623015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.623435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.625405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.627327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676f030-480f-45cf-a204-df68411ec280 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.630797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 190/376] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.632897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.633341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.633783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.635312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 187/377] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:17.636317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.661751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:17.663428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:17.703851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.745866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 191/378] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:17.747117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.759596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33931-5b93-45e0-b61e-3da778270080 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.773727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.802669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.803290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.803577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.803849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.804581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=92887987e56748fe85411bb09e82b246) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:17.804889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.809525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.817328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 188/379] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.914109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb86b-ea6d-400c-bad1-bc5e341124c5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.961272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.962199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.962618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.963049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] PATH_INFO: `/v3/projects/2044597fee4e41239b157ed6c7f1c415` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.964653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] RBAC: Authorizing `identity:get_project(project_id=2044597fee4e41239b157ed6c7f1c415)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.966241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.968389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 192/380] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/projects/2044597fee4e41239b157ed6c7f1c415 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.974502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.111401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445540-f946-49a4-9632-63247236ce1b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.139070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.150726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.151370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.151651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.151922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] PATH_INFO: `/v3/groups/51dbb23107474329ad475031fae956a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.156935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] RBAC: Authorizing `identity:get_group(group_id=51dbb23107474329ad475031fae956a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.158495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.161024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 189/381] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/groups/51dbb23107474329ad475031fae956a5 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:18.166659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.198673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.333878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.353784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d380-3cb8-41f9-85e9-36a3dbdb487c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.377840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576aa1-36e9-405d-9db8-120186fc5b3d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.418388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.418946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.419225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.419502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.427659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.428266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.428528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.428911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.429771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] RBAC: Adding query filter params (group.id=51dbb23107474329ad475031fae956a5, role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=2044597fee4e41239b157ed6c7f1c415) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:18.430082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.431546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.432659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:18.438035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:18.438909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:18.439715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 190/382] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:18.447118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 193/383] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/role_assignments?group.id=51dbb23107474329ad475031fae956a5&scope.project.id=2044597fee4e41239b157ed6c7f1c415&role.id=91c74d335ba54b558054c228da1b6365 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:18.448265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.514486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.558712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d265cc-b98b-42bf-86fb-a42c55f8f7f8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.595484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.596099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.596386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.597185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.598437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:18.599005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.600841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.610405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 191/384] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:18.618329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.750995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ae658-2a83-483f-97a3-e958c0975bb3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.796116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.796765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.797048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.797320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.799190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.801087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.803177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 194/385] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:18.808656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.966455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122520bb-315c-4da6-bdc5-eccec2187888 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.982353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.011773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.012337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.012622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.012907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.018219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.020412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9138a-dc4e-4e80-8449-fd128f87dfbd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.022541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 192/386] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:19.028217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.057238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.103105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624249-be41-4d06-abcc-a855fd31bc91 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.103423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624249-be41-4d06-abcc-a855fd31bc91 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.103668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d624249-be41-4d06-abcc-a855fd31bc91 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.105157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 193/387] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:19.116637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.116973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.117240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.157323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:19.158540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:19.170610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55f74-6fe9-49e0-b8d2-a1982c51aad1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.211835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.212514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.212797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.213074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/groups/88dcbdaced7f44baa61ab6043233d65d/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.219970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, group_id=88dcbdaced7f44baa61ab6043233d65d, role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.221431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.257497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 195/388] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:19 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/groups/88dcbdaced7f44baa61ab6043233d65d/roles/ec1eab75eebd4484b004466d3dede7cb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:19.285732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 194/389] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:19.748893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.863569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.886699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356965-5429-48a6-94e4-60f0ca197670 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.930424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.931061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.931338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.931607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.949022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-66b77ae6-fb69-42ff-8aa9-31a437652e90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:19.954294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:19.955256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:19.956671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 196/390] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:19.963734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.980636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ea5ec-024e-4663-951b-ae818605a7c8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.980972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ea5ec-024e-4663-951b-ae818605a7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.981291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ea5ec-024e-4663-951b-ae818605a7c8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.982530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 197/391] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:19.988277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.989060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.989532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.015835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:20.017249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:20.166466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 198/392] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:20.185370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6533c73-b938-449f-b60d-a87d92fb16a7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.199478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.231096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.231946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.232366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.233686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:20.234181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.235693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:20.249116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 195/393] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:20.255550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.343125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.383983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8ef2-34d4-42c5-9fe4-f77fb6e1a04f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.428030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.428937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.429358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.429806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.431116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.432704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:20.434464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:20.439890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.559171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.569325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d0c7-08f9-4465-9dfa-842111c45664 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.628614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.629244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.629542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.629820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.630962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.632405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:20.634108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 196/395] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:20.639841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.718967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.753074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a48f-7630-4a27-a917-3eff2135c787 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.810442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.811672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.812582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.813329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.822282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994de-2053-42ff-9aca-632cf03d1ce9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.823799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.830906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-65b15206-6729-4a58-b0fb-23dfe69cfb10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:20.839409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:20.840322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:20.841123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:20.842879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 200/396] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:20.844806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f32ee-2265-4462-a771-6b6ded887ea9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.845090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f32ee-2265-4462-a771-6b6ded887ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.845363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f32ee-2265-4462-a771-6b6ded887ea9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.851732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 201/397] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:20.851732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f32ee-2265-4462-a771-6b6ded887ea9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.871548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.872541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.873025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.873396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/groups/88dcbdaced7f44baa61ab6043233d65d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.875504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] RBAC: Authorizing `identity:create_grant(project_id=cb48b0cdf4a644b18d382ca906e72d05, group_id=88dcbdaced7f44baa61ab6043233d65d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.877015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018b47d-3795-4a31-8a7d-dd9402e3f45a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:20.892179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 197/398] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:20 2022] PUT /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05/groups/88dcbdaced7f44baa61ab6043233d65d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:20.901493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.901493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.901493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.938622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:20.939844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:21.042785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f32ee-2265-4462-a771-6b6ded887ea9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.078436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 198/399] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:21.100191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.100824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.101110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.101387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.102167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:21.109556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.109556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bcb38-1dc9-483c-9807-447efc35be70 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.114375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 202/400] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:21.119506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.167017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.259605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909413e-36e1-4f93-840e-2f96c70fd980 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.265020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd08-0a7a-4081-bf3b-26ff7f62a2a7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.265433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd08-0a7a-4081-bf3b-26ff7f62a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.265676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edbd08-0a7a-4081-bf3b-26ff7f62a2a7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.267656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 203/401] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:21.278520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.278932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.279303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.305827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.306469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.306749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.307022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.308971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.310432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.315603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 199/402] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:21.316419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:21.317533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.318860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:21.426047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.428109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea50d1-a9cd-4f73-a7be-b538b3657df8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.438154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.455472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 204/403] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:21.457759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.494753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.495407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.496333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.496333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.498662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.500190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.502298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 200/404] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:21.510155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.574965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d5cbf-1526-435f-8e7d-c6ad77c5549a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.614864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.616080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.616573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.617052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.628851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:21.633990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:21.634965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:21.635748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:21.639236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 205/405] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:21.645735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.702350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.764619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c40b7-eca2-4039-b16b-eb71c895fdbf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.783826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740239f-afe6-4a1c-b52e-73416bf8a888 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.817327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.817993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.818367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.818650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.819430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:21.819741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.821365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.823957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.824614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.824892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.825165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/groups/88dcbdaced7f44baa61ab6043233d65d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.827211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, group_id=88dcbdaced7f44baa61ab6043233d65d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.828643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.832013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 206/406] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:21.833868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.845558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 201/407] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:21 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/groups/88dcbdaced7f44baa61ab6043233d65d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:21.847453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.876184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.978978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3eb9a-dcd7-4105-aac6-2b24a806bc04 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.023631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.024348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.024684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.025234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.026485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.027634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355157d8-bedb-4ba8-b051-29c41f2339e4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.027972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.033532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 202/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.036844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.061914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.128932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.129654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.129939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.130213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.152771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:22.158297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:22.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:22.160614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 207/409] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:22.173921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.191642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.207114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a086-8aff-48c1-a020-25f79487bc98 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.293455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.294918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.295419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.295892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.297268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.298946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45daf7c-685f-4b1b-a699-ac9f2ee33253 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.301578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 203/410] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.303061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e049a-84c9-429e-86f2-a9b0d534fb11 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.303548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e049a-84c9-429e-86f2-a9b0d534fb11 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.304056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e049a-84c9-429e-86f2-a9b0d534fb11 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.305470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 204/411] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:22.311075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.311634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.312110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.322831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9ebe-c060-457c-8eb0-ee894d1b3114 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.333184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:22.334724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:22.369233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.369968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.370229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.370503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.371172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:22.371546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.372962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.384804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 208/412] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.385908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.413620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 205/413] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:22.414932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.429224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.506600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f6d-2a71-4822-b974-d7cab39b47fc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.546304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.547416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.547788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.548158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246/groups/88dcbdaced7f44baa61ab6043233d65d/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.551113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=92887987e56748fe85411bb09e82b246, group_id=88dcbdaced7f44baa61ab6043233d65d, role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.557546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.571391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 209/414] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:22 2022] PUT /identity/v3/projects/92887987e56748fe85411bb09e82b246/groups/88dcbdaced7f44baa61ab6043233d65d/roles/ec1eab75eebd4484b004466d3dede7cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:22.629434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.642382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7ea7-f3af-4532-a92b-e8faf0ae6042 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.697619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.698272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.698555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.698829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] PATH_INFO: `/v3/groups/51dbb23107474329ad475031fae956a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.699988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] RBAC: Authorizing `identity:get_group(group_id=51dbb23107474329ad475031fae956a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.701452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.703533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 206/415] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/groups/51dbb23107474329ad475031fae956a5 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.709030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.762117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.851389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.859191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290350-74d2-45ac-a8cd-ba774ce843c8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.898444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.899087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.899369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.899643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] PATH_INFO: `/v3/projects/2044597fee4e41239b157ed6c7f1c415` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.900881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=2044597fee4e41239b157ed6c7f1c415)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.902471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.904346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 210/416] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/projects/2044597fee4e41239b157ed6c7f1c415 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.910371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.911144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3291b4-8b1d-4664-8d98-aeb5d83dfe32 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.950224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.954011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.954590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.955089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.986439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:22.991500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:22.992393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:22.993189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 207/417] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:23.001460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.042626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.054634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6edad5-a5d9-4f37-b6b7-e6386df18bf2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.138738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.139420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.139704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.139981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] PATH_INFO: `/v3/projects/2044597fee4e41239b157ed6c7f1c415/groups/51dbb23107474329ad475031fae956a5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.147116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] RBAC: Authorizing `identity:create_grant(project_id=2044597fee4e41239b157ed6c7f1c415, group_id=51dbb23107474329ad475031fae956a5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.148603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.173393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34872264-7428-4778-bb5b-34379c12af91 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.177742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 211/418] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:22 2022] PUT /identity/v3/projects/2044597fee4e41239b157ed6c7f1c415/groups/51dbb23107474329ad475031fae956a5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:23.215849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.216468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.216749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.217028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.217745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:23.218054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.219567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dbf8d-e336-43b0-b3cc-9af288b55c93 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.230190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 208/419] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.235764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.276523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.387191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2551-cead-48f6-93a6-fc62419a6455 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.432366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.432978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.433257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.433549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.457547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddda7-4cd2-41f3-a185-a7627e8fd99a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.458054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddda7-4cd2-41f3-a185-a7627e8fd99a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.458128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddda7-4cd2-41f3-a185-a7627e8fd99a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.459686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 209/420] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:23.465928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.466211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.466485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.494280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:23.495499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:23.511043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.512519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.538485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.607124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 210/421] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:23.619222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 212/422] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:23.624970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.646284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.760057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a19d5-0aff-4af7-a700-0a8ea4d87c63 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.797201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.797869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.798147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.798417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.799552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.801112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.803052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 211/423] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.808371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.944001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca38dd-4fe9-4051-b229-e735a0c8015a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.983897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.992110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.992997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.993276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.993605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.994747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.996191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.998095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 213/424] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.003885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.023130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.132213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a744e4-9fe4-426e-aeb4-88086f43456c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.170712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.171354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.171630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.171898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.197479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.202411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:24.208041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:24.208937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:24.210139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 214/425] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:24.215511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.233043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db527-2700-413a-b6fb-19ade03fdcaa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.301943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.303003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.303526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.303998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.304972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:24.305477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.308767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.320557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 212/426] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.323542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.387361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f83b-ed33-4a8a-b418-77f175584bb1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.425969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.426941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.427418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.427882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.428777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:24.429295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.430910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1037-0e76-4f5a-bf1b-d4ba1a47a62c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.441125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 215/427] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:24.446636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.465677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69144512-3251-474e-ac61-94dbfbc8d2bd None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.466016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69144512-3251-474e-ac61-94dbfbc8d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.466185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69144512-3251-474e-ac61-94dbfbc8d2bd None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.467511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 216/428] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:24.473746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.474075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.474290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.509599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:24.509599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:24.616273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784e11-1b21-4988-8914-6c066d0d5fa8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.626564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 217/429] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:24.662274 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.663149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.663577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.664043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.679104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.747229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.748670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.861219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 213/430] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:24.867859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.914355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.914628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.969343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.974126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629535-24fd-4d4b-a64a-45b8c9489809 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.010055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.010611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.010895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.011171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] PATH_INFO: `/v3/projects/cb48b0cdf4a644b18d382ca906e72d05` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.012350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] RBAC: Authorizing `identity:get_project(project_id=cb48b0cdf4a644b18d382ca906e72d05)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.013884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.015796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 218/431] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/projects/cb48b0cdf4a644b18d382ca906e72d05 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.021431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.045989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1d7f2-6d6b-495e-bd3c-84e059dcef32 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.094052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.094052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.094052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.094052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.109657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:25.115566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:25.116495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:25.117308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:25.119983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 214/432] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:25.133533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.145195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4cec-58b9-4df3-8321-4c086db62b14 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.155723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.180881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.181524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.181843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.182097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.183210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.184656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782555-6c31-44a0-ac07-b63a1ea1dcb7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.186387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 219/433] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.192185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ab04-26ed-4638-b859-24454dce5352 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.192514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ab04-26ed-4638-b859-24454dce5352 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.192743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ab04-26ed-4638-b859-24454dce5352 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.194116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 220/434] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:25.194661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ab04-26ed-4638-b859-24454dce5352 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.242120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60271-fae4-47d6-a037-c63ee839ee7e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.244065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.277106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.277673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.277956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.278233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.278896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:25.279202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.280590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113852-5a25-4656-8ec4-2a1f80b7c51d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.293869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 215/435] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.293869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.293869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.293869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.309280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ab04-26ed-4638-b859-24454dce5352 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.309527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:25.310714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:25.347936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.348541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.348815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.349085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.349841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=cb48b0cdf4a644b18d382ca906e72d05) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:25.350146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.351608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.367117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 221/436] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=cb48b0cdf4a644b18d382ca906e72d05&role.id=a7ea816836af4541b645f88001cb4469 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.367117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.382912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 216/437] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:25.416124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.482545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870a96f-1d09-4436-9933-1b533b60e6db None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.523987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.525005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.525493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.526024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.600918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.602770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.648008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.652120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.716937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 222/438] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:25.722513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.762915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.770888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3f283-124d-46a2-902a-f0a2a82228d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.817466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.818163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.818448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.818723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.831577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:25.837534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:25.838746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:25.839612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 217/439] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:25.844706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.848505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff32a4-47cb-4450-9981-9790e9a2ba10 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.887451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.888017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.888341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.888620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.890031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.891221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.892998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 223/440] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.898559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.911824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.973286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d2fdf-e4e2-4eaf-9025-d3c6e3af8752 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.015349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.015964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.016242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.016517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.017184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:26.017487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.019179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.023987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f679e-9491-4499-bcab-046ae8838919 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.033614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 218/441] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:26.035628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.059729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.063818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.064790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.064790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.065029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.066711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.069047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be871-9fe8-4e02-8c3e-4c1d2d74e52f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.070056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 224/442] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:26.071214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab1ab-ede7-4984-a5ab-e79c107bc38d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.071497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab1ab-ede7-4984-a5ab-e79c107bc38d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.071768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab1ab-ede7-4984-a5ab-e79c107bc38d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.073200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 225/443] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:26.077059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab1ab-ede7-4984-a5ab-e79c107bc38d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.164806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f410-520d-4781-998a-8567b2e52a9d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.169499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.192664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab1ab-ede7-4984-a5ab-e79c107bc38d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.197406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.198044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.198325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.198599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.227411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.227989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.228264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.228536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.229248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=a7ea816836af4541b645f88001cb4469, scope.project.id=92887987e56748fe85411bb09e82b246) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:26.229578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.230999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da83e49-309d-4863-9a0f-6286491f1530 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.236483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 226/444] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=a7ea816836af4541b645f88001cb4469 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:26.238075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.238364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.238634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.257998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:26.259230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:26.283453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.286956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.305991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.342365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 227/445] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:26.398773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 219/446] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:26.404282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.484606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.516911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9e9b-b53d-4194-8487-0afad9b71e44 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.552187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.552816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.553097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.553374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] PATH_INFO: `/v3/projects/92887987e56748fe85411bb09e82b246` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.554512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] RBAC: Authorizing `identity:get_project(project_id=92887987e56748fe85411bb09e82b246)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.556001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.557836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 228/447] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/projects/92887987e56748fe85411bb09e82b246 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:26.563200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.622759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.677029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ada7-4377-41ef-b73c-c0040deac46b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.693001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.711416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.712300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.712534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.712919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] PATH_INFO: `/v3/groups/88dcbdaced7f44baa61ab6043233d65d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.714386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] RBAC: Authorizing `identity:get_group(group_id=88dcbdaced7f44baa61ab6043233d65d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.715890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.717453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 220/448] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/groups/88dcbdaced7f44baa61ab6043233d65d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:26.724031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.727863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd13fd-a987-4306-af2a-04260d9ea101 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.761849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.762409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.762688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.762958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.770893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.774532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:26.779561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:26.780620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:26.781601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 229/449] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:26.787253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.827560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc341-c384-4958-8936-efd65f706767 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.860659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.861258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.861562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.861832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.863169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] RBAC: Adding query filter params (group.id=88dcbdaced7f44baa61ab6043233d65d, role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=92887987e56748fe85411bb09e82b246) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:26.863479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.864911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.870557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 221/450] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/role_assignments?group.id=88dcbdaced7f44baa61ab6043233d65d&scope.project.id=92887987e56748fe85411bb09e82b246&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:26.886778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b2c3-004b-4de1-b75d-1bd3c271bba4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.923166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.923795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.924077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.924354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.925809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:26.926124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.927558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.936841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 230/451] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:26.943842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.996185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:27.052007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5b24d-607e-47cb-854f-4f746e52d08c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:27.085182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:27.085897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:27.086180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:27.086452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:27.157854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:27.160149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:27.206917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:27.260063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 222/452] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:27.265776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:27.325212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:27.363876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9bd7e-07f1-4685-8ae9-2272604aa3cf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:27.396709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:27.397317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:27.397625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:27.397900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] PATH_INFO: `/v3/projects/2044597fee4e41239b157ed6c7f1c415` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:27.399005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] RBAC: Authorizing `identity:get_project(project_id=2044597fee4e41239b157ed6c7f1c415)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:27.400436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:27.402053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 231/453] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:27 2022] GET /identity/v3/projects/2044597fee4e41239b157ed6c7f1c415 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:27.407547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:27.500706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282b96-6c8d-45a4-b108-3ac667161ff4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:27.533171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:27.533848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:27.534127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:27.534401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] PATH_INFO: `/v3/groups/51dbb23107474329ad475031fae956a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:27.535493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] RBAC: Authorizing `identity:get_group(group_id=51dbb23107474329ad475031fae956a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:27.536916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bdebf-aff2-4b3f-b61e-77fb541b08be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:27.538460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 223/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:27 2022] GET /identity/v3/groups/51dbb23107474329ad475031fae956a5 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:27.544102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:27.639619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270b18e-18c4-4846-9f6b-27ffe793df85 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:27.666310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:27.672036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:27.672621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:27.672899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:27.673169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:27.673904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] RBAC: Adding query filter params (group.id=51dbb23107474329ad475031fae956a5, role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=2044597fee4e41239b157ed6c7f1c415) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:27.674209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:27.676187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2321a9-e5e3-4ad1-8997-ad30dad5cf08 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:27.681658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 232/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:27 2022] GET /identity/v3/role_assignments?group.id=51dbb23107474329ad475031fae956a5&scope.project.id=2044597fee4e41239b157ed6c7f1c415&role.id=91c74d335ba54b558054c228da1b6365 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:30.238507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62740d-e634-416d-88b1-0393c205868d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.239054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62740d-e634-416d-88b1-0393c205868d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.239054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62740d-e634-416d-88b1-0393c205868d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.240705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 224/456] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:30.255364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5aff8-b6a5-4cd3-a083-68c5fe343be3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.255826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5aff8-b6a5-4cd3-a083-68c5fe343be3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.256036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5aff8-b6a5-4cd3-a083-68c5fe343be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.281810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d2c5aff8-b6a5-4cd3-a083-68c5fe343be3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:30.283027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d2c5aff8-b6a5-4cd3-a083-68c5fe343be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:30.380361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:30.759235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a829-b5d5-4b29-9b23-4a47a2452468 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.759573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a829-b5d5-4b29-9b23-4a47a2452468 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.759692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a829-b5d5-4b29-9b23-4a47a2452468 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.761268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 225/458] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:30.774244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510025-a154-48cb-a6dc-17f7a61e6de4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.774713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510025-a154-48cb-a6dc-17f7a61e6de4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.775184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510025-a154-48cb-a6dc-17f7a61e6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.786772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a829-b5d5-4b29-9b23-4a47a2452468 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.801526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-71510025-a154-48cb-a6dc-17f7a61e6de4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:30.802978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-71510025-a154-48cb-a6dc-17f7a61e6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:30.805807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.913639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 234/459] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:30.915187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f60-0d51-41ed-86f0-6c5aeaa56c0b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.915478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f60-0d51-41ed-86f0-6c5aeaa56c0b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.915757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f60-0d51-41ed-86f0-6c5aeaa56c0b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.917488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 235/460] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:30.922782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da330e-6b8c-49ce-aac9-0d020d629a3f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.923071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da330e-6b8c-49ce-aac9-0d020d629a3f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.923346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da330e-6b8c-49ce-aac9-0d020d629a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.942624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-97da330e-6b8c-49ce-aac9-0d020d629a3f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:30.943151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a829-b5d5-4b29-9b23-4a47a2452468 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.943831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97da330e-6b8c-49ce-aac9-0d020d629a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:31.008716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.028193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.028775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.029064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.029342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.030973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 236/461] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:31.036918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff62ca-d0ce-4761-a75d-ba099d34f63b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.037282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff62ca-d0ce-4761-a75d-ba099d34f63b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.037585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff62ca-d0ce-4761-a75d-ba099d34f63b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.039188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 237/462] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:31.049989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.050488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.050887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.054462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.055934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.073029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:31.074855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:31.083572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:31.085457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:31.086561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:31.086561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.086561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:31.086561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 226/463] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:31.109569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.172483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 238/464] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:31.261046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.305217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.307617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebea42-c8e5-4d92-a0d9-0fd072b52ce6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.351895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.352514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.352791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.353064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.353741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:31.354042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.355433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.381262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 227/465] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:31.386809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.462265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7131-0fdd-4db5-9119-df331b302c01 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.478826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.498183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134ded-eb06-41ae-9250-d9d0523cf128 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.500974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.501850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.502130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.502402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.514474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.515929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.527100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:31.532507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:31.533395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:31.538672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:31.538672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.538672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:31.538672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 239/466] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:31.538672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.539040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.539040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.539040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.539040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.552268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.553775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:31.570163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:31.571064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:31.571912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:31.571912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.571912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:31.571912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 228/467] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:31.572131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.646244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19ea8-ccf2-4eec-ac84-59a978f6182b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.679761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4f7da-f93b-4b89-a0f1-a45e981bd334 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.680265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.680864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.681144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.681416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.682079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.683524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.708150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 240/468] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:31 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:31.709066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.728184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.729204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.729779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.730278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.739224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.746704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.748658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:31.767374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:31.769014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:31.769901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:31.769901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:31.769901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:31.771821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 229/469] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:31.773103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.823977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.837446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83438ac-1ebf-4d13-8f08-95a51e42b120 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.881490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.882174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.882456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.882728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.883390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:31.883691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.885164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.909416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 241/470] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:31.914533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.918563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0c4-46d0-4b0a-a7c4-e056762a8009 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.958465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.959077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.959356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.959629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.960331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:31.960570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.962019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.978565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 230/471] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:31.979522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:32.011314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:32.030720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cd4eb-0e72-44cb-85df-0d3f52787cf5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:32.070168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:32.071227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.071689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.072197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.073306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:32.073764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:32.075209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:32.089074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 242/472] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:32.093677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:32.110776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:32.125322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c615c5-07bb-4504-bc34-56e7254b8548 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:32.173805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:32.175189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.175476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.175813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.177296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:32.178793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:32.210025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 231/473] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:31 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:32.210718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:32.212319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ced38-43ba-43ea-a644-d5d310f645f9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:32.277093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:32.278842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.279343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.280337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.281654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:32.284480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f4c03-dd3e-4279-90f8-289214623ca8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:32.309625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:32.326387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 243/474] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:32.326387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd029f9-0a94-42fb-8a0d-da403d800667 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.326387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd029f9-0a94-42fb-8a0d-da403d800667 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.326387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd029f9-0a94-42fb-8a0d-da403d800667 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.326387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 244/475] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:32.332240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.332551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.332797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.361341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c6b0-5978-422f-8de7-f386c6c1ad46 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:32.374742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:32.376178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:32.431424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:32.432173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.432529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.432874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.433763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:32.435321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:32.467928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 232/476] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:32.496088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 245/477] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:32.788832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:32.793094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:32.922270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb623ff5-dc1f-4c8c-9694-eb75709ea40a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:32.966754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:32.967409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.967696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.967970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.968651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:32.970056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:32.989399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.sql.core [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:32.989399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 29 01:58:32.989399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [parameters: {'id': '4fa95d910ece438fb4896f074dcd52e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 29 01:58:32.989399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81554) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Sep 29 01:58:33.010668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return ref.to_dict() Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:58:33.011604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application yield resource Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise self.value Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application session.commit() Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:58:33.012531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:58:33.013422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:58:33.016021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:58:33.021734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [parameters: {'id': '4fa95d910ece438fb4896f074dcd52e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:33.025131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 29 01:58:33.027158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:33.033116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 233/478] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:33.033274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.144421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9b7b-e7e8-4323-8f1e-3b718b7f4501 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.173865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.188929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.189644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.189951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.190847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.210633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-54bed3e3-923a-46be-849c-5dea98002125 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:33.215707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:33.216596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:33.218471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 246/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:33.223526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.322779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.369546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1963-50cf-4360-9ae6-699b87842e6f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.414485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.415094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.415375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.415645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.416313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:33.416615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:33.418029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e6a21-b148-4974-b8c1-07fde5c8bd04 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:33.431298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 234/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:34.561905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e70-8b60-47bd-8df5-b1e1815610e1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.562412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e70-8b60-47bd-8df5-b1e1815610e1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.562412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e70-8b60-47bd-8df5-b1e1815610e1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.563942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 247/481] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:34.570283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c432-bc88-42fd-b1bd-49b459e61605 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.570721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c432-bc88-42fd-b1bd-49b459e61605 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.570817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4c432-bc88-42fd-b1bd-49b459e61605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.593295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b6c4c432-bc88-42fd-b1bd-49b459e61605 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:34.594518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6c4c432-bc88-42fd-b1bd-49b459e61605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:34.667773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 235/482] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:34.920300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b41f-c853-4fd8-bc41-4ca4b541bcf4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.920666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b41f-c853-4fd8-bc41-4ca4b541bcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.920999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b41f-c853-4fd8-bc41-4ca4b541bcf4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.923254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 248/483] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:34.928615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8825-2c6d-4ef0-bf34-0be6816ed45c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.928906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8825-2c6d-4ef0-bf34-0be6816ed45c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.929182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8825-2c6d-4ef0-bf34-0be6816ed45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.952057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8dfc8825-2c6d-4ef0-bf34-0be6816ed45c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:34.953269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8dfc8825-2c6d-4ef0-bf34-0be6816ed45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:35.022258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.035121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 236/484] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:35.053171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b41f-c853-4fd8-bc41-4ca4b541bcf4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.063555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230987-9ba9-49ba-b408-394640090e33 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.066081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230987-9ba9-49ba-b408-394640090e33 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.067602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230987-9ba9-49ba-b408-394640090e33 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.070050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 237/485] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:35.074894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b4d5-5869-4625-90ad-ab6a4544707d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.075248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b4d5-5869-4625-90ad-ab6a4544707d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.075584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b4d5-5869-4625-90ad-ab6a4544707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.109470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a37b4d5-5869-4625-90ad-ab6a4544707d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:35.112704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a37b4d5-5869-4625-90ad-ab6a4544707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:35.230548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b41f-c853-4fd8-bc41-4ca4b541bcf4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.235490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 238/486] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:35.239788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a134ec-ece5-4d39-bccc-eba7efcabe7b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.239788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a134ec-ece5-4d39-bccc-eba7efcabe7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.239788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a134ec-ece5-4d39-bccc-eba7efcabe7b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.239788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 239/487] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:35.262956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.263318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.263657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.290437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:35.293970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.294668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.295012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.295346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.296010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:35.316565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:35.321723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.322812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.323842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:35.329885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 249/488] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.332277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.385477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 240/489] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:35.386347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.388266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.435738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.448901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecafac2-2b6d-4e86-b257-f74f78b34a15 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.487032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7785e-8332-4f9e-9dfb-11cf3630e930 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.491841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.492708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.493179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.493708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.494580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:35.495598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.497663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.510734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 250/490] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:35.516582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.541025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.542233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.543349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.543978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.566453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:35.575366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.576776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.577604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:35.581251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 241/491] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.588848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.662190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4d69-91ff-43fa-8f91-9326dbb9759a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.673008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.698962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.699655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.699942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.700214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.714044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.715503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.716851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e387-1cbe-4531-bd2c-c9cb313eabaf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.728751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:35.730189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.731169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:35.732115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:35.732115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.732115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:35.735868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 251/492] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:35.736573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.760492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.761106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.761388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.761699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.762367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:35.762680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.764561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.773835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 242/493] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:35.774726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.849330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01ae6-9ea4-4055-80c5-99bbf4c76ee9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.879910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240205-798b-4a75-abfa-2f4ee4b43c3c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.885745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.886382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.886668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.886946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.900505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:35.906340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.907225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:35.908036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 252/494] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.908780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.923275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.923918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.924755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.925181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.934945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.937040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:35.943823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.944723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 243/495] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.945974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.978005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.029545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099470f-5e65-4303-88a2-f39cd5fc6ec5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.052463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1533c5-5cfc-44a5-aaf5-80bc166e49b4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.063001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.063695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.063984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.064314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.064998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.065307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.066742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.081613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 253/496] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.085698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.097249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.097918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.098195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.098464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.110951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.112590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:36.127859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.128857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:36.130113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:36.130113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.130113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:36.130113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 244/497] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.134119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.173153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.197879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac59c88-8792-46e7-9aa4-bce1dcddd934 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.226056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.235694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.236302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.236592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.237072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.237794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.238097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.239465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.243684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c714-1d52-46c9-a009-57deaaab192c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.248504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 254/498] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.249125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.284872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.285401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.285710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.285982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.286647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.286947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.288344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.297652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 245/499] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.298448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.363848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0452fe2-6f5b-4a81-8d9a-4b3f3ed655d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.398842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.399744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.400184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.400461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.408465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.410666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.411500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d587-6827-4d63-af96-0fbb28a7de5e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:36.428230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.429213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 255/500] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.430163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.434720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.454906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.455555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.455838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.456108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.456750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.457050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.458450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.470223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 246/501] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.471516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.480423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.540883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31388-6b3b-480a-a567-65ed1de4d9b8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.572032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c663-fe7c-434a-94b3-bf78c23c350a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.577358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.578026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.578310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.578588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.589224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.590722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:36.605069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.606291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:36.607378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:36.607378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.607378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:36.607378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 256/502] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.607605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.608017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.608089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.608089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.608089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.621055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.622519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-35d0ed9b-0a47-4f4d-af7b-f08200c935ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:36.636655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.637742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:36.638659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:36.638659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.638659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:36.638659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 247/503] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.638963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee895a-5fa2-4f80-8d4e-607ad1e74754 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.639244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee895a-5fa2-4f80-8d4e-607ad1e74754 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.639522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee895a-5fa2-4f80-8d4e-607ad1e74754 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.640881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 248/504] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:36.641403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee895a-5fa2-4f80-8d4e-607ad1e74754 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.671571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.703108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.716922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d38047-701d-4332-89bf-e5ebcfa3ae50 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.747265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee895a-5fa2-4f80-8d4e-607ad1e74754 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.749822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.750421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.750701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.750971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.751683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.751985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.753706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.780506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.781216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.781500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.781799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.789774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.791260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.792745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 257/505] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.793478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:36.804981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.805921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 249/506] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.806876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.898022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de9f9d-aaab-4dc3-bd06-26ffc6287971 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.910362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31790f4e-1a14-472b-9b41-f68bef9851b4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.912044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.927316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.932260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.932892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.933175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.933449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.934119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.934420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.935856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeea26-a252-4b20-a81c-2c92c4d43d34 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.944124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.944725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.944999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.945267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.945935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.946234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.947384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 258/507] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.947609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.948613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.948898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.949338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.960079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 250/508] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.960880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.967758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:36.968956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:37.034686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 259/509] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:37.035316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.061539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad16e0-5099-46ef-b4eb-635a72ec99f5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.099708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.101597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.101597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.101597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.152577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.166183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db855aa-bd73-456e-b1c5-52089826203b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.168567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.178899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.180372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.203384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.203997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.204280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.204554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.205277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.205679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.207145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.225074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 260/510] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.225901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.297331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 251/511] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:37.298422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.334991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1c960-fb07-430c-8430-3c7aae06195e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.368243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.368872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.369151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.369423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.375721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.376254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.378108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:37.389931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:37.390984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:37.391879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 261/512] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:37.392449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.402346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b6f32-b1b7-4e1f-93cc-b6e0382f1579 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.417188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.436564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.437218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.437500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.437822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.444815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.446281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:37.458151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:37.459106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 252/513] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:37.460009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.494073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28598fa-ef15-41a5-9e98-c1ee4c6a7680 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.527759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.528372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.528651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.528920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.558675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fdf3-bc30-4224-ab7e-c4f43833f0ee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.593809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.594357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.594641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.594913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.595219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.597405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.602113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.607110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.608564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.619994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:37.622772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:37.623691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:37.624527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:37.624527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.624527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:37.624527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 253/514] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:37.624975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.699655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 262/515] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:37.700492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.730595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d33a6-f9df-4f32-912e-190ab810be7d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.763208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.763829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.764108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.764384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.775408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.776855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:37.790563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:37.791495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:37.792462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:37.792462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.792462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:37.792462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 254/516] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:37.792462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.799406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493a4d-84ac-492e-8b6b-52d7977d8d11 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.821760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.834473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.835075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.835356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.835631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.836351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.836655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.838121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.839371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.855641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 263/517] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.856441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.900589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aaa45-5458-4ebd-a181-3e1c32967da4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.934112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.934793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.935143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.935480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.936288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.936657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.938190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.952563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a39320-b793-46da-bb46-3914dba5dd14 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.974892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 255/518] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.975710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.992223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.992833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.993113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.993393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.994063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.994448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.995828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.007679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 264/519] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.008285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.048546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.074059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.077027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb47e-798b-48f5-b920-6f042e693825 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.107327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734bba5-8ca7-42fb-8c97-b3c89014a5c5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.118110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.118745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.119023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.119295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.129170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.130655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.141320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.141960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.142240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.142511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.143676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.143981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:38.145524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.146541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:38.147430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:38.147430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.147430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:38.147592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.147659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 256/520] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.147659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.157566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 265/521] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.159321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.253106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88629e67-4284-4ee6-b0af-3d80834f8334 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.257274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.260515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf8251-0c22-405a-b900-b6980afdd85b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.285653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.286265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.286547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.286829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.294008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.294615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.294901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.295179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.307750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.353560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.355050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.360942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.362908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.452341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 257/522] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:38.453275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.457949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.466357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 266/523] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:38.466357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.508903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.554332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ebfc-8011-4340-8568-a768ee11f56f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.560884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb576b2-9cec-409a-98e7-8a89ecc40927 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.589246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.589876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.590151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.590425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.591053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.592486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.594959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.595558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.595837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.596648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.597280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.597612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.598976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.610909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 267/524] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.612504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.614871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 258/525] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:38 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:38.615528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.697079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.731621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f34f-d3fe-49df-97bc-e787e5732d86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.742615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.747117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f6cd-baba-41ca-89d8-acf3bbd7ec8f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.775342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.776415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.776889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.777326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.786494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e5aab-b198-4663-9394-f24851203948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.787364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e5aab-b198-4663-9394-f24851203948 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.787652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e5aab-b198-4663-9394-f24851203948 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.787923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e5aab-b198-4663-9394-f24851203948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.792553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.794115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.798428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e5aab-b198-4663-9394-f24851203948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.799810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e5aab-b198-4663-9394-f24851203948 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:38.811208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.812120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:38.812952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:38.812952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.812952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:38.812952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 259/526] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-848e5aab-b198-4663-9394-f24851203948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:38.813178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.813986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.815393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:38.815889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.815960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 268/527] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.816906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e5aab-b198-4663-9394-f24851203948 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.927383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e5aab-b198-4663-9394-f24851203948 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.927846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00779e6b-c5c9-4c9b-aa96-910d33d600f2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.947775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.963626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.963817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.964256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.964442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.964554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.964722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.964817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.964991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.972587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.974092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.978887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.980570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:38.985445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.986332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 269/528] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.987818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:39.001144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:39.002348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:39.003238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:39.003238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:39.003238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:39.003238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 260/529] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:39.003453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.022219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.103493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba263af4-c31e-4f9d-b0d0-2b23fa8b74ec None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.122432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6de3-8519-4fbf-ac1d-940f1cee43fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.139323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.139936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.140223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.140489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.141133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.141436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.143380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.156837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 270/530] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.161820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.162352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.162455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.162745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.162961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.163755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.164066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.165493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.188658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 261/531] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.188658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.208908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.267813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.272102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4702-66d3-4652-aa0d-8c8b1eb8e1ca None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.303329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4c81-5b88-4ee0-8499-7b8e1c46a355 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.307590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.308203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.308486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.308758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.309449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.309790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.311215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.329348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 271/532] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.330201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.347731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.348121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.348382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.348652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.349306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.349648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.351020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.367851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 262/533] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.367851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.439365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.443092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc96c7c-d987-4e8d-bd4c-1f86deebcc0c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.476150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af156e-adca-47d5-a025-734245a5f952 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.478838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.479537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.479816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.480115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.487021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.488478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:39.499498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:39.500336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 272/534] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:39.506609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.509898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.516087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.516695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.516971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.517246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.518714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.519272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.520728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.526306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 263/535] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.527146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.649563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360e882-fca4-4049-9eac-7044309fac41 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.661462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78b1d-f9db-4694-8b9d-bc2edf58a112 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.688937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.690278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.690895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.691570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.693231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=f19ed5110c5d43bf89d25d1c85d132b3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.693765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.696519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.700480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.701116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.701395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.701707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.704037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 273/536] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/role_assignments?user.id=f19ed5110c5d43bf89d25d1c85d132b3&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.706150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.710665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.712394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:39.728279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:39.729214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:39.730533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 264/537] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:39.736026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.744687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.811230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.867215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775489-565c-455f-ba31-5fb48f06c057 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.883686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d1c3-e0cf-4ff1-9162-e4c3ad26c81c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.909794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.910955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.911435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.911925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.912858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.913359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.915614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.930818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 265/538] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:39.936186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.948079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.948632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.948919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.949198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.950078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.950273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.951871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.965950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 274/539] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.973096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.061920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.063446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166b2e-5f71-43d6-9d7f-27beb8adc84f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.079331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620fbb-69a3-4cb0-b679-81412b17f7fc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.085838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.110169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.111253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.112474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.113220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.114231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=420c2ac652344d45a417f490e095a217) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:40.114737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.116391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6670646-57f0-4c1c-882c-6f9678eaeb14 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.116869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.117486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.117791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.118066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.118789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=737a97e6d4b6419da95d4e1fc4618970) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:40.119097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.120540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873c03-ce3c-4ee3-b9a7-467abcd4df3e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.124544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 266/540] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/role_assignments?user.id=420c2ac652344d45a417f490e095a217&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:40.133581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 275/541] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/role_assignments?user.id=737a97e6d4b6419da95d4e1fc4618970&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:41.053960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a96d2-3c3f-4110-b5c6-57e8031f89da None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.054478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a96d2-3c3f-4110-b5c6-57e8031f89da None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.054579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a96d2-3c3f-4110-b5c6-57e8031f89da None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.056117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 267/542] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:41.061397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.061813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.061996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.081125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:41.082365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:41.182742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 276/543] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:41.453813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a96d2-3c3f-4110-b5c6-57e8031f89da None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.590697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a96d2-3c3f-4110-b5c6-57e8031f89da None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.635893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.636529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.636814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.637098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.652048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:41.656924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.657861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:41.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 268/544] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.664926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.786228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.809282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec05534-d2a2-4932-858d-6abe2b2695bb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.844596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.845211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.845493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.845796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.846607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.846915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.848367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.856811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 277/545] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.863173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.906496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.980258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc098d1-9d6b-423c-a7d3-4f59355c24de None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.026203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.026895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.027183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.027461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.041018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.042440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:42.058989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.061705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:42.063768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:42.063768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.063768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:42.063768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 269/546] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:42.066680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.220309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55fb30-f47b-464b-b27f-2bbf534b3637 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.273228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.273894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.274172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.274443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.275100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.275397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.276789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a100-8e0a-4531-b484-5cdc2f06690f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.290836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.295230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 278/547] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.300600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.384269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ed9e6-f9a4-4fbe-898b-037fa7548bb1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.384605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ed9e6-f9a4-4fbe-898b-037fa7548bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.384818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ed9e6-f9a4-4fbe-898b-037fa7548bb1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.389535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 279/548] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:42.395236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebef18-ddc8-4b7e-94a4-67fcbb192cd7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.395523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebef18-ddc8-4b7e-94a4-67fcbb192cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.395796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebef18-ddc8-4b7e-94a4-67fcbb192cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.431314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a3ebef18-ddc8-4b7e-94a4-67fcbb192cd7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:42.432912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a3ebef18-ddc8-4b7e-94a4-67fcbb192cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:42.453883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.463911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4116d7-b44c-434a-856c-8910520fd595 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.501273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.501937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.502774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.503405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.512036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.513666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:42.526225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.527763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:42.528772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 270/549] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:42.532754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.617181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 280/550] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:42.647510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd978-25b2-4cfe-9b5c-775ea9222168 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.675840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5373-3139-4932-a891-e703aeca557b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.676168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5373-3139-4932-a891-e703aeca557b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.676451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5373-3139-4932-a891-e703aeca557b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.678070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 281/551] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:42.685635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e9f-e3a9-4adb-b14b-01fa4142762d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.685928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e9f-e3a9-4adb-b14b-01fa4142762d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.686205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e9f-e3a9-4adb-b14b-01fa4142762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.687551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.688220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.688502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.688772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.689500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.690012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.691769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.717876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 271/552] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.719845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.722779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-105a3e9f-e3a9-4adb-b14b-01fa4142762d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:42.724039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-105a3e9f-e3a9-4adb-b14b-01fa4142762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:42.744461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.860694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 282/553] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:42.868675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463f4b-7f2d-4059-b9ad-422b5156a39b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.870531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f784-939d-4bf6-ab0f-392dad6f8c31 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.870826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f784-939d-4bf6-ab0f-392dad6f8c31 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.871081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f784-939d-4bf6-ab0f-392dad6f8c31 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.872635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 283/554] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:42.878387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.878674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.878951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.899892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:42.901585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:42.906117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.906286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.906560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.906828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.973157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.990876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 284/555] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:42.992175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.019020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.020941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1525f3-09f2-4e06-8ef2-a77bb621241f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.036595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.122096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf326a02-5f7b-4cbb-b7b0-e8b3ee28c905 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.183233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 272/556] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:43.184498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668763bf-6917-4af9-adbf-b4143a2fbae8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.184772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668763bf-6917-4af9-adbf-b4143a2fbae8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.185044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668763bf-6917-4af9-adbf-b4143a2fbae8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.186515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 273/557] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:43.190054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668763bf-6917-4af9-adbf-b4143a2fbae8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.190769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.191423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.191707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.191982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.203733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-98a08931-6050-4c24-a4ef-f7023b082baa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:43.208776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.209712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:43.210654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 285/558] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.211339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.211339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.216787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.231956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:43.233226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:43.281515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.304443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668763bf-6917-4af9-adbf-b4143a2fbae8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.309643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 286/559] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:43.310721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.316564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.342326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.342959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.343237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.343508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.354007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.355445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:43.372335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.373253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:43.374869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:43.374869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.374869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:43.374869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 274/560] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:43.374869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.426400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887582-45ca-4060-8ee9-f58e07014e9c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.462862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.463825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.464118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.464370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.475515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:43.480256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.481158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.482606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:43.483239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8981-9f0e-463d-8855-dab7ca930a83 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.483327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 287/561] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.483327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.521259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.521892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.522170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.522437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.523092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.523391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.524996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.527665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.533077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 275/562] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.534204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.560085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.593649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb2cd-6841-436d-9b75-ccf5406c0e18 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.628198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.628761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.629042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.629315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.638680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e793a-bc9c-4bfa-b388-23e46a013c9a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.639545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:43.644899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.645905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:43.646727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 288/563] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.648065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.674623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.675437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.675716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.675984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.676625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.676922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.678305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.689500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 276/564] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.691373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.748448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.751670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360d8ba-4690-4617-b907-6df1fc96fb4d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.775679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.786615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.787226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.787510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.787789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.788446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.788751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.790190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.793043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cf436-63fa-427a-b687-ea9a391cb154 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.798009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 289/565] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.798792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.836644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.837276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.837584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.837860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.849788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.851280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:43.865528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.866494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:43.867424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:43.867424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.867424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:43.867424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 277/566] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.867424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.901272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eea396-12a2-48c2-9ef6-8c625d4c8626 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.933997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.934623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.934910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.935184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.945821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:43.951146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.952121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 290/567] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.952956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.967228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91cc1-b8bd-49e0-bf17-302e237079c7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.977448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.000785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.001388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.001703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.001989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.003354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.003661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.005041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.007314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.013719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 278/568] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.014503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.053147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826637-bf1c-41e2-8431-f0bd958455b3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.085865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.086493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.086774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.087047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.094322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.097167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:44.109010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.109960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:44.110870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:44.115207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b11b-a46d-4897-9347-1f2e0d4695f2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.115845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 291/569] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.116637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.149063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.149719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.150000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.150278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.160979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.162432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:44.176726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.177818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:44.178720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:44.178720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.178720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:44.178720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 279/570] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.179356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.201615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.223731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314cba5-a06c-4a04-80a6-baff66facba4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.233564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.256987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.257621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.257900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.258169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.258799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.259219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.260596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.272397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 292/571] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.273174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.287988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095652b-4d2b-403b-af0d-550360400407 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.320988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.321618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.321899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.322170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.322824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.323123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.324483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.333521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 280/572] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.334333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.375484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92330d-337f-4595-a036-4f3c10ae8b88 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.409346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.410099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.410381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.410653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.420426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.421844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.423505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.431914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845cbd-161f-4667-92f3-9f5b23a1300b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:44.438118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.439162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:44.440154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:44.440154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.440154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:44.440154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 293/573] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.440758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.448541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.476541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.477160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.477436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.477744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.478434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.478735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.480154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.492007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 281/574] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.492799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.543943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa35d0-fa72-424e-b1bd-74891d6bb222 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.576850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.577451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.577760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.578041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.578676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.578982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.580959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.590051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76dfe-98c5-4f21-b9ee-331efd945294 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.592560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 294/575] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.593335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.623764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.624556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.624846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.625124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.632955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.634422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:44.646751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.647890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:44.649317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 282/576] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.653098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.655919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.684222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.700522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6382-f34c-4493-aed8-ec016ff30ba5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.734506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.735130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.735408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.735686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.745408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.746961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.753703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427086-7795-4ea7-a92e-5f5d9f177cf7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:44.761781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.762762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:44.763711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:44.763711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.763711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:44.764364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 295/577] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.765332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.788167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.788777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.789058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.789337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.790019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.790327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.791709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.803848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 283/578] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.804632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.868424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f35f-e0b4-4748-8a22-6b8f46f4dafa None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.875648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.894764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.903477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.903927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4c3e-bda4-45af-b191-24183182ac9a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.904076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.904355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.904627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.905345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=33c9ac2314b84688b03c1e9f2924595b) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.905677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.907120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.912316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 296/579] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/role_assignments?user.id=33c9ac2314b84688b03c1e9f2924595b&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.913088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.951755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.952321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.952604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.952946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.962610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.964453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:44.977669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.978715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:44.979706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:44.983708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 284/580] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.984653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.042482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa617a-44b2-4795-b6ba-4068e755fdd7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.079962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.080649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.080932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.081207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.081973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.082281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.084127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.100253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60394e-c5bc-412f-9a3a-467f2b49762b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.104560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 297/581] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.105243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.136203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.141991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.142609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.142885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.143161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.143802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.144108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.145479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.157782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 285/582] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.158457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.173017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.219884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e829bf-dcdc-4b6e-aa9a-870a42506bac None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.256517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.257148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.257431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.257729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.264815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.266308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.272079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcef5f-42a8-424f-bcde-d4f08b28d639 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:45.278276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.279211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 298/583] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.280163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.316242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.317203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.317489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.317786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.318640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.318949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.320378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.340426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 286/584] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.341267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.386824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.402235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92bf6-1a05-4bf7-89dc-0632e8305323 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.418161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.438875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.440049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.440483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.440942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.451259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c2bc2-b897-4894-aefd-b2203f93a2e0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.451481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.452899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:45.469361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.470511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:45.471452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:45.471452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.471452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:45.471452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 299/585] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.471686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.492359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.492985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.493262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.493549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.500645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.502707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:45.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.516273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:45.517196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:45.521470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 287/586] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.522322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.583182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226341e2-c8be-4353-8c09-ed572be12ea7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.622787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.623395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.623673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.623945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.624669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.624975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.626424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.631708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f386f-604d-40ee-87f6-0d9e36603ff4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.636799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.646262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 300/587] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.647348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.666896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.674550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.675188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.675473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.676191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.688265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.689816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:45.704533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.706405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:45.707298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:45.707298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.707298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:45.707298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 288/588] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.707298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.760959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377805d-802d-4bcb-ae16-a8c5b88b6698 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.798146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.799185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.799468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.799939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.800384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.800687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.802094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.814077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 301/589] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.814957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.826764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcbe83-f923-4ec5-91bb-fcf658e39eae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.863948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.864887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.865313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.865765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.866767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.867219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.868847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.875463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.889332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 289/590] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.890345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.920144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94ae4-a8b3-4a95-adc9-2732ef1055a2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.935871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.959057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.959824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.960113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.960455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.972602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.974225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:45.988550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.989730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:45.995259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:45.995259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.995259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:45.995259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 302/591] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.995259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.007029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930980cb-a629-470d-8982-5ebd9bbeb2a4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.042108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.042734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.043093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.043470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.044235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.044677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.046170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.057996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 290/592] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.058745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.111013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2e414-0fcb-4fa0-bab0-e0092d11b138 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.122351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.148998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.149673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.149963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.150227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.156941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.159354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:46.170917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.171817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:46.172708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 303/593] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.173194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.180468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.183430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e918-b3b6-4bad-a69e-6191f316fb90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.225799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.226540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.226828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.227102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.238579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.240031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:46.254245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.255226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:46.256128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:46.256128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:46.256128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:46.256128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 291/594] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.256378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.289126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a55e2-4f5c-4752-93f9-7546f385ab65 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.326514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.327050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.327334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.327608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.328263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.328548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.329954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.346814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 304/595] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.346814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.371601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a99-ce5a-4df6-8dc9-2d5802ef5470 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.377240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.406840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.407473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.407753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.408029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.415178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.416632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:46.430240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.431151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:46.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 292/596] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.433092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.449407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.458807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900cca-38ee-4ac0-9fdf-9f6ed3fa958c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.496909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.497549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.497841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.498094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.498783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.499091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.500532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.512179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 305/597] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.512972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.545189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc451a-d8b6-476e-ad90-c4af0d496183 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.582113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.582640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.582922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.583195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.583837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.584143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.585536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.599369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 293/598] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.600466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.628279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.640137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbe1d-6e14-47ed-b37e-1e15b30a31da None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.673894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.678510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.679160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.679427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.679700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.686942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.688392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:46.700559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.701680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 306/599] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.707890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.715083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029532-01fe-4a40-9b3a-367806a7a61f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.752664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.753476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.753790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.754068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.754761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.755074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.756501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.769695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 294/600] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.770954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.826574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df49e-52eb-4d00-b3f3-7336b78e58f4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.860796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.861683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.861936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.862211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/f19ed5110c5d43bf89d25d1c85d132b3/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.877443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=f19ed5110c5d43bf89d25d1c85d132b3, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.878931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.889664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.893811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5995d-3529-41c9-989d-13441749aec4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.905602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 307/601] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:46 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/f19ed5110c5d43bf89d25d1c85d132b3/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:46.906631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.936025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.942072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.943382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.944140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.944764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.954968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.956801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:46.972874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.974135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:46.975286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:46.977079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 295/602] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.978202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.053289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645f6a-4f77-48ef-ac0c-cb958c453f1b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.093165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.093965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.094340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.095122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.096485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:47.096888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.100577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.113726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 308/603] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:47.114636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.116151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0239d2-2cf3-4a7f-adde-6450565fffde None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.152814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.153483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.153793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.154069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.169030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=b95c7c9fe9fa4536a3bcd298cfc7f9b7, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.171186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a635bb-1bdd-42b4-8c77-53666de90e8a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.181130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.185877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 296/604] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:46 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:47.187280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250e62-3bdd-465c-b6f7-8c56794b602d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.187703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250e62-3bdd-465c-b6f7-8c56794b602d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.188162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250e62-3bdd-465c-b6f7-8c56794b602d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.189767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 297/605] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:47.194453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc250e62-3bdd-465c-b6f7-8c56794b602d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.235135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82220e91-6ec0-40bd-82c9-13dfdb7c28a1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.262472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.283380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.284377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.284906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.285393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.286636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:47.287231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.289003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9367d0-a001-49e4-9719-d845354e7d88 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.304893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 309/606] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:47.307092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.307667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.308339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.329026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:47.331513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:47.351593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc250e62-3bdd-465c-b6f7-8c56794b602d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.400870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.401495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.401770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.402095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/737a97e6d4b6419da95d4e1fc4618970/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.419377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 310/607] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:47.419835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=737a97e6d4b6419da95d4e1fc4618970, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.420205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.421302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.457531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 298/608] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:47 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/737a97e6d4b6419da95d4e1fc4618970/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:47.473390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.528455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae6bc-866b-4d14-8197-7fce081768c2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.566102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.566886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.567240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.567586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/420c2ac652344d45a417f490e095a217/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.584977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=420c2ac652344d45a417f490e095a217, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.586550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.608315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 311/609] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:47 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/420c2ac652344d45a417f490e095a217/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:47.769272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.883563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.895733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a278e0-4f4e-4358-ab77-f4ae6c08728d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.935288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.936160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.936668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.937087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.948656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:47.953722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:47.954809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:47.956265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:47.963068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 299/610] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:47.964846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.088927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b866f-dfd7-46e9-a445-ed25445ae8ca None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.090676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.145237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.146163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.146586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.147013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.147822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.148265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.149820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.163782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 312/611] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:48.169399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.306004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c603-722d-4a21-8c0c-95de1814e99c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.354978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.355938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.356376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.356796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.375523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.378042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:48.394939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.396114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:48.397212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:48.397212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.397212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:48.398973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 300/612] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.406030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.549640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a45e3-938c-4cc9-9d2c-26b39ae77436 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.598187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.598801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.599087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.599365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.600011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.600318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.601718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.618687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 313/613] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:48.624199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.641187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.816971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36e81a-67aa-4ba8-ab8b-493cb4302476 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.864910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.865586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.865874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.866183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.875683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.877664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:48.892506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.893758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:48.895326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 301/614] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.899635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.944084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.039630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f094239-3d2f-4dbf-8277-2f3017d6309b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.074033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.074645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.074978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.075260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.075991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.076300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.077755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.096578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 314/615] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.106882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.287003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.369367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78a5ff-312e-4578-b58d-645d8b5a5118 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.455779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.456424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.456706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.456986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.487106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.488578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4db8f0a3-b53d-4cb6-bc60-f97418280e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:49.515759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:49.516745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:49.518688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:49.518688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:49.518688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:49.518688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 302/616] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:49.522812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.662773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade484-ba91-4c05-b10a-e5001336210f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.663313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade484-ba91-4c05-b10a-e5001336210f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.663313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade484-ba91-4c05-b10a-e5001336210f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.665013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 303/617] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:49.670351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344350-a126-4c4b-9015-f2d30052e6c3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.670564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344350-a126-4c4b-9015-f2d30052e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.672922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344350-a126-4c4b-9015-f2d30052e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.703937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.727792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85196a-28e6-4078-9b03-c1071a3692af None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.746673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-18344350-a126-4c4b-9015-f2d30052e6c3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:49.747840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18344350-a126-4c4b-9015-f2d30052e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:49.765592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.766190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.766463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.766738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.767399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.767879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.769466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.782751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 315/618] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.788699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.913265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 304/619] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:49.968643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7fa5-0012-4570-9d91-5e6134c61aa6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.969156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7fa5-0012-4570-9d91-5e6134c61aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.969619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7fa5-0012-4570-9d91-5e6134c61aa6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.972814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 305/620] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:49.977359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.977858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.978275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.989277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e60a6-2c0f-4fcb-a1b6-4b26d5508ed1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.005241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:50.006789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:50.067456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.070090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.070090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.070090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.070090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.079063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.081497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.092026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:50.108601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.109594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:50.110512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:50.113539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 316/621] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.118131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.129617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 306/622] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:50.283076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25401-cf28-459c-90a9-81d4690f70b7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.336913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.337575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.337862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.338135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.339122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.339435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.340906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.361941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 317/623] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.368213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.371829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.473771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.513894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26baca-8f1b-4c13-b77e-acbb6d623a39 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.520298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853523bd-8fdd-4390-8e87-201e42cc3dd5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.547460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.548053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.548334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.548607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/33c9ac2314b84688b03c1e9f2924595b/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.553426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.554072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.554349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.554616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.563132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=33c9ac2314b84688b03c1e9f2924595b, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.565056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:50.565268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea07c1-0c37-4cc2-ab8d-54720d86b859 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-939f6746-80d1-47b1-b5ca-941c4f223bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:50.570137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.571308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:50.572224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 318/624] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:50.573869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4da6-bccb-45f1-8a9a-c106be455180 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.573869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4da6-bccb-45f1-8a9a-c106be455180 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.573869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4da6-bccb-45f1-8a9a-c106be455180 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.574596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 319/625] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:50.575276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4da6-bccb-45f1-8a9a-c106be455180 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.586034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 307/626] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:50 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/33c9ac2314b84688b03c1e9f2924595b/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:50.587265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a54b6-9442-43f5-9a1f-0c3ca5d147fc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.587554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a54b6-9442-43f5-9a1f-0c3ca5d147fc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.587831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a54b6-9442-43f5-9a1f-0c3ca5d147fc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.589375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 308/627] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:50.590215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a54b6-9442-43f5-9a1f-0c3ca5d147fc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.623164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.710230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4da6-bccb-45f1-8a9a-c106be455180 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.718465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a54b6-9442-43f5-9a1f-0c3ca5d147fc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.734139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.750577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.751483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.752825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.753299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.756972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.758265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.759246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.759246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.759532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.759750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.761164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e897c6-eb56-4082-9d9c-4ec1e945e050 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.768762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:50.772531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 309/628] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.773915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.774306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.774681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1ea3da23-0977-4ca3-bc61-04c732376ad7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:50.775202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.776292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:50.777373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 320/629] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.778211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97269c1-5988-4239-b270-019ab250c777 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.778211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97269c1-5988-4239-b270-019ab250c777 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.778211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97269c1-5988-4239-b270-019ab250c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.797693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a97269c1-5988-4239-b270-019ab250c777 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:50.797878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:50.798986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:50.799090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a97269c1-5988-4239-b270-019ab250c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:50.881532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 310/630] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:50.881532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.881834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 321/631] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:50.881834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97269c1-5988-4239-b270-019ab250c777 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.895217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.036519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8394d0-8ac5-4f35-81e5-d0c5952c8693 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.057354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97269c1-5988-4239-b270-019ab250c777 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.084436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.085421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.086802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.087081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.087356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.115802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.117630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.138819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:51.144820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.145900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:51.146798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:51.146798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:51.146798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:51.148023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.148521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.148989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.149995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.150492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.152051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.155990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 311/632] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.162769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.165101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 322/633] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.174429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.255456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.290552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014fcd-8b6b-4838-9186-2726888976b5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.299126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311cd1b-d0f7-4bf5-998e-9973a43f0253 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.327050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.327585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.327865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.328133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.328837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.329147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.331896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.335577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.336270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.336615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.336948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.345125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 312/634] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:51.345125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.352217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.353728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:51.368363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.369330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:51.370564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:51.370564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:51.370564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:51.370564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 323/635] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.370810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.398794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.471670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d299e34-e3ca-4003-8bdd-6322d8c5320d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.474812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2148c-f6eb-40e2-82f2-5dc3b03f9326 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.506118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.513097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.513339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.513765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.514005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.514120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.514289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.514388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.514572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.525683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:51.526729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:51.530908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.531830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:51.538118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:51.538797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.539672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:51.542927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:51.544491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 324/636] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.544637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 313/637] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.544637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.544906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.625353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.641798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbfe36-9f7f-404c-b95c-6ff28d93a460 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.646049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475ebf-583b-4a38-add7-e22a7dbb114b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.675683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.676306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.676588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.676859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.682970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.683576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.683856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.684127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.684765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.685068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.685263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.686465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.686707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.699019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 314/638] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:51.699642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.700671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:51.701639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:51.702196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.703745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 325/639] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.704567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.761316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.812678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06c35e-b6fb-45b6-915d-e4c5e5d97ddc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.817030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf660c92-ac5c-48de-982d-3d49328eec9d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.850477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.851057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.851341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.851612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.852274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.852581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.854020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.854646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.855601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.856034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.856782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.857635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.858103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.860071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.862801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 326/640] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.863603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.874113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.880837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 315/641] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.880837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.971892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8ca6-c97d-41f1-8bf2-bd58c5003fa6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.988161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec4f2-6b61-4637-adeb-2ce6d80da15e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.002447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.013795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.014430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.014710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.014981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.022679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.024317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.028779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.029387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.029699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.029974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.030699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.031006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.032412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:52.039137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.040340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:52.041560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:52.047545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 327/642] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.047545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.062546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 316/643] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.062546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.120584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.159764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8007-0946-419f-bc27-107f64af6632 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.169817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd0d4b-af02-45bc-8b82-10f29bc8e2cc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.195189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.195924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.196269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.196613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.206632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.207345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.207699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.207795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.208102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.209636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.219084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.221131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:52.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.226460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:52.227726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:52.227726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.227726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:52.229066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 328/644] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.230573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:52.239197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.240347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:52.241458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:52.241458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.241458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:52.245803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 317/645] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.246914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.272668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.340780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8667ed-b47e-4b89-93d7-16d1731b35ac None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.355092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff8091-88a8-44f4-b164-4a2cdbe15ae1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.359447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.378176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.378788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.379074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.379348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.380070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.380381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.381914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.390439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.391055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.391333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.391604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.400359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 329/646] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.401527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.470605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.472046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.498612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.512289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671740a-75db-4e0b-9b66-678c2f6df173 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.549319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.550583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.550583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.550583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.551228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.551530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.552896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.570197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 330/647] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.570197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.587713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 318/648] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:52.587713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.613226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.682675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99633be-4994-4afc-84a7-797fd06bc91a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.700594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca72ed-45e0-4996-95fb-64835d59e788 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.721812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.722748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.723246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.723587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.724238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.724547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.725977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.726410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.738282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 331/649] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.739110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.745147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.745818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.746106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.746383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.816255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.817741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.834620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.841322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeda9-03cc-434e-ab21-155661869863 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.874986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.875604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.875882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.876152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.884074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.885531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:52.896276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.897226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 332/650] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.898204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.919676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 319/651] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:52.920507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.944312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.003095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3b49-b44a-4898-b5f9-e65047ff9535 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.018331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a00c-18c3-45a4-ab7f-e53555cd567a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.035364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.035988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.036268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.036539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.046735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.048189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.051943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.052568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.052847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.053119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.060333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.061858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d0561025-d616-427a-8b89-6837a50df726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:53.062624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.063655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:53.064879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:53.064879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:53.064879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:53.068232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 333/652] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.069456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fa62-bcc4-4fed-b93f-0a8fe6f861c6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.069761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fa62-bcc4-4fed-b93f-0a8fe6f861c6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.070034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fa62-bcc4-4fed-b93f-0a8fe6f861c6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.071275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 334/653] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:53.071955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28fa62-bcc4-4fed-b93f-0a8fe6f861c6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:53.073732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.074713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 320/654] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.076282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.087677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.160079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.178813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5d122-053b-4da5-b440-9fd8db49203b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.184314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28fa62-bcc4-4fed-b93f-0a8fe6f861c6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.211745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.212390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.212677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.212954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.221113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.221765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.222044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.222654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.223037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.223354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.224325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.224779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457149-b6d5-4a42-ba61-f23f072e3915 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.225778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:53.240221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.241219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:53.246871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:53.246871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:53.246871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:53.246871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 321/655] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.247113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 335/656] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.247189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.247266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.247266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.247266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.262997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:53.264229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:53.323249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.331333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 336/657] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:53.332134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.356327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167641-160b-4f40-9a78-23ba3def4c0b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.389831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.390522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.390715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.390992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.391632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.391938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.393908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.395293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.406634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 322/658] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.406895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.442186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0f62-4ca7-4cd6-8c9d-7ff13dfbc7cc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.478131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.478743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.479028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.479305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.480031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.480344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.481798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.499040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 337/659] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.499862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.515153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b3894-5c56-43bd-a689-33e1c9358aea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.550397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.551016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.551301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.551581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.552222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.552528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.553924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.557525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.570690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 323/660] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.570690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.610272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec24d6-3bf3-45af-beba-f586f101054f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.624311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.644383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.644992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.645272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.645567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.669209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7570b2-6e5b-457d-82c3-946876c93dbc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.701899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.702522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.702801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.703073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.709593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.710980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.711849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.714461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:53.723382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.724475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 324/661] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.725528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.769609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.813639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 338/662] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:53.815017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.828149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfa6e0-53b7-494a-bdfd-05480d6fd763 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.843147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.863934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.864569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.864852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.865129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.915292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec4a6-6010-4123-b23f-0ff954cbf8b1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.932328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.933807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.947926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.948572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.948849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.949117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.956373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.957831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:53.968951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.970179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:53.971849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 339/663] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.972441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.990449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.032473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 325/664] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:54.033935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.048156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.073790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86624c-377b-4592-afa9-665eb3f6371a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.110816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.112008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.112286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.112560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.122642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:54.128001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.129111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 340/665] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.130053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.135480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716547a-5a58-4f08-a341-b29328aae046 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.168224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.168825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.169107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.169381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.170099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.170405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.171819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.183634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 326/666] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.184418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.207755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.232379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11ae52-f4d9-4aac-b3c9-0b199fb0c990 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.257330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.266237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.266866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.267147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.268079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.278437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.279885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.290648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e2d-c6c1-45f3-ac99-113b6f2a599a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:54.293771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.294876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:54.295786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:54.295786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.295786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:54.295786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 341/667] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.296050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.324643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.325374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.325784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.326332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.327115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.327484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.328902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.341467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 327/668] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.342285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.393751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29a56-232b-414e-8824-ba9943833d0a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.418013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.427310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.427938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.428216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.428507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.438581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.438984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737076c-4313-4a6b-a17f-d426333d6b97 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.440625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:54.454565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.456217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:54.457116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:54.457116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.457116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:54.457116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 342/669] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.457901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.477934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.478540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.478820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.479089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.479748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.480052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.481407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.482732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.490371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 328/670] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.491361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.567690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ed4d-6e82-4e78-bd60-e5bd373ac9f1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.591702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0d6e-9804-4e9f-990f-947c2c751e4d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.602122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.602756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.603031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.603299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.604013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=f19ed5110c5d43bf89d25d1c85d132b3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.604314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.605784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.611941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 343/671] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/role_assignments?user.id=f19ed5110c5d43bf89d25d1c85d132b3&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.612917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.630164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.630793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.631078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.631348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.632039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.632346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.634396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.648268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 329/672] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.649137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.664250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.715936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.731289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee742-1118-4482-9bd9-e65aeb98a0ab None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.765863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e60b-efa0-4484-88f2-c064f003a836 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.777840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.778577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.778851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.779123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.779846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.780147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.781720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.788001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 344/673] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.788819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.803976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.805248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.805781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.806729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.807925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.808463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.810170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.833731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 330/674] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.833731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.932757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a144-bf94-47bc-8bac-074173185642 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.942266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.961738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb765bb-77fc-42e7-b472-d43d0ee7a93a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.973677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.974485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.974861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.975232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.979833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.988070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.989780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.004102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.005086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.005623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.006097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:55.007001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.007933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:55.008828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:55.008828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:55.008828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:55.008828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 345/675] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.009065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.017433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.019540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:55.034402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.035435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:55.036336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:55.038369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 331/676] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.039395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.129228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdd83-65ce-4ba1-bc86-64c2ddd441d1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.171842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436cf9f-a3db-41aa-ba50-aedce7739203 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.172069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.172716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.172996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.173267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.181929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.183775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:55.198036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.199146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:55.200053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:55.201750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 346/677] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.202672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.213706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.214324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.214605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.214879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.215635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.215946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.217437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.224883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.233903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 332/678] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.235199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.275462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.318910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5d224-3ac5-4164-b020-847d9ed39eef None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.356143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64905f2-42cd-45d0-8e9b-c55059f582e8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.358102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.358951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.359380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.359811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.360643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.361696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.363539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.377475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 347/679] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.378565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.395462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.396525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.396833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.397108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.398101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.398474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.400062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.413455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 333/680] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.414766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.466929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.497730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97d87-0828-4528-aa42-de134e69e859 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.534675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.535686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.536172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.536647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.537074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.544446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3122-630f-4863-88cb-b0958864e561 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.545673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.547508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:55.559979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.561039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:55.562396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:55.564443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 348/681] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.565575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.583273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.584388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.584943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.585470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.586429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=420c2ac652344d45a417f490e095a217) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.586958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.589636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.598791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 334/682] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/role_assignments?user.id=420c2ac652344d45a417f490e095a217&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.599949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.701005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d156-5d13-4877-8a5a-e63445526123 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.733270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca705b-0984-491c-a646-c564d324c7ea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.741262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.742641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.743132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.743609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.744596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=737a97e6d4b6419da95d4e1fc4618970) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.745128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.746954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.754888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 349/683] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/role_assignments?user.id=737a97e6d4b6419da95d4e1fc4618970&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.775446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.776077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.776387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.776632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.777395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.777767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.779293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.801906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 335/684] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.807490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.817386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.961428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb75ad8-172a-4f66-96fe-03cb2cbafb23 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.999493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.000346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.000803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.001224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.086165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.087624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.089958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.202375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 350/685] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:56.208549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.239126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.337943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbba05-9e90-46ea-a450-8f8a15cb0079 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.374022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.374656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.374938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.375214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.386182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.387639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:56.402616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:56.403584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:56.404914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:56.404914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:56.404914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:56.404914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 336/686] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:56.410594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.581556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64f0b0-f0ca-464b-bc47-a29e2ef855fc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.583019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.622257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.622869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.623148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.623418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.624061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:56.624363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.625756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.644870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 351/687] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:56.650444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.738401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.772818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c1ec-ef1c-4037-9090-86b17d884710 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.813870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.815223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.815508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.815782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.827757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.829234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:56.841242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:56.842166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:56.843639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 337/688] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:56.848991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.007873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1b826-52ac-4943-b8c1-81dd1c9e6587 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.055352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.055973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.056253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.056528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.057221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.057538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.058973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efea30-37b6-434c-bc6e-6bb3be90af4f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.075123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 352/689] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:57.081175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.250905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd176-3423-431b-b7b9-2d856bbdc401 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.285831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.291917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.292528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.292802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.293066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.293822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=33c9ac2314b84688b03c1e9f2924595b) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.294132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.295893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db3fd-2735-4fc1-98b8-6deb65be7ac5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.302613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 338/690] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/role_assignments?user.id=33c9ac2314b84688b03c1e9f2924595b&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:57.426202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753b2c-7fbb-442a-8361-a1525e62b6a4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.426408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753b2c-7fbb-442a-8361-a1525e62b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.426688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753b2c-7fbb-442a-8361-a1525e62b6a4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.428283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 353/691] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:57.433734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.434062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.434292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.462559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:57.464059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:57.473272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54d3c-83b8-4805-be69-774511a4bdcc None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.473635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54d3c-83b8-4805-be69-774511a4bdcc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.473866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54d3c-83b8-4805-be69-774511a4bdcc None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.475626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 354/692] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:57.481437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.481759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.482040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.502754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:57.504078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:57.524381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.573525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 339/693] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:57.588757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 355/694] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:57.864872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.875095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.998703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9e366-6e42-4d1b-80db-1c79abf3fca2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.019378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c593-9463-4fb3-850d-6a7f7970cd39 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.033910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.054306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.055289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.055778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.056252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.075001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.076874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.095986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.097032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.097531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.098007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:58.104221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:58.105149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:58.106096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:58.106096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:58.106096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:58.112012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 340/695] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:58.116178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.124917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:58.130352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:58.131290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:58.132126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 356/696] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:58.146579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.172338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.243075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34cdf-2661-4160-8a83-122017445cea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.279458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405835-5548-48b7-90af-314704737fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.280883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405835-5548-48b7-90af-314704737fbc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.281347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405835-5548-48b7-90af-314704737fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.281804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49405835-5548-48b7-90af-314704737fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.282599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49405835-5548-48b7-90af-314704737fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:58.283735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49405835-5548-48b7-90af-314704737fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.285272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49405835-5548-48b7-90af-314704737fbc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.299074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 341/697] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:58.306345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405835-5548-48b7-90af-314704737fbc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.349436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c0a4-1e7c-4cea-b7fd-77fef60dc2fc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.371887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.422223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.422859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.423140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.423965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.424940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:58.425171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.431629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.452457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 357/698] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:58.458302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.499000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49405835-5548-48b7-90af-314704737fbc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.562966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.563962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.564545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.564975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.565833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.567654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce85e88-dbf2-4a7f-a9ff-e91ecb7bb8d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.574625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.594851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 342/699] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:58 2022] POST /identity/v3/users => generated 254 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:58.597171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5a96-b231-43a3-990b-cf49f8391e5b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.597724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5a96-b231-43a3-990b-cf49f8391e5b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.598207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc5a96-b231-43a3-990b-cf49f8391e5b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.600262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 343/700] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:58.607405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34493f0-0ec9-40c6-8e41-1a782211fd03 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.607960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34493f0-0ec9-40c6-8e41-1a782211fd03 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.608375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34493f0-0ec9-40c6-8e41-1a782211fd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.609473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757c3a-6053-41aa-a368-a76a3c7bb752 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.629780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c34493f0-0ec9-40c6-8e41-1a782211fd03 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:58.631237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c34493f0-0ec9-40c6-8e41-1a782211fd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:58.654067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.655270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.655641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.656021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.671104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.673119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:58.703924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:58.706190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:58.707458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:58.707458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:58.707458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:58.715162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 358/701] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:58.718973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 344/702] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:58.721225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.827930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87eb63-67ea-4f90-a5de-bfe11d3292a0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.828375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87eb63-67ea-4f90-a5de-bfe11d3292a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.828751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87eb63-67ea-4f90-a5de-bfe11d3292a0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.830844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 345/703] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:58.836723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.837149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.837475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.857766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:58.859177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:58.878241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d4b0-1980-40e1-9b1b-4b1d7b0e0dc5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.879082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.915865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.922111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.922918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.923258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.925019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.925801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:58.926444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:58.928089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:58.940471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 346/704] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 29 01:58:58.944303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 359/705] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:58.949538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.044225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.058184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78031a-6bd3-4e96-89e5-6461d07446c6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.111038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.111828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.112103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.112473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.120450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.122163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:59.135122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.136117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:58:59.137047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 347/706] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:59.143957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.170964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.199358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa573db7-3103-4963-885d-94c34a6faf12 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.268125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.269133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.269698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.270177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] PATH_INFO: `/v3/services/network` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.270963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.272554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.273037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15298140-9713-4bd6-aa21-ab10c61d74c4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.284055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.285125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:59.286047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.288813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 360/707] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:59.289911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.312947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.313698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.313874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.314759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.315990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.316297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.317813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.340104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 348/708] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.341070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.348012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.403493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d185-11ac-4c63-9d62-1cea0a8a8451 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.434090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.447804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.448694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.448986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.449261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.449891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.452096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.465969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.467009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:59.467866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:58:59.472098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 361/709] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:59.473365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.476043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eef7-5bb7-4522-b002-71f7b1093772 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.516563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.518142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.518657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.519138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.520134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] RBAC: Adding query filter params (name=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.521431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.523063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.528569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 349/710] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.530017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.596831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91bc9d-c70a-4bf4-bc69-9787338b1e82 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.613925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.637046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.637688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.637969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.638242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.647197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68cf8-edf7-4734-bd17-377c0243e980 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.692507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.693890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.694626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.695106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.696076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.696601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.698209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.699611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.704960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 350/711] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.706229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.724547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.726232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.824899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd42e22-3cd5-4087-99cf-4720fc6f6ee1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.837138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 362/712] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:59.837831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.854329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.866352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.867399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.868107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.868588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.870193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.870750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.872355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.880423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 351/713] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.881643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.010196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.017024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1cf2f-9fb9-49d1-b46f-84195e0b1d69 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.076344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.076779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.077064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.077339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.078000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.078314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.080240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.086563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 363/714] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.087283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6f615-1232-46c4-9192-980353e43b6e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.163169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.163847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.164133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.164406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.186299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.187818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0aea5b22-f683-4ae5-a111-c378e28ad05e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:00.210163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:00.211223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:00.212126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:00.212126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:00.212126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:00.215999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 352/715] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:00.217279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.309715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.350132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5220-dd86-4404-936a-0f224936afcd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.379673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574652f-12c1-437d-b8b0-c268867363a6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.380220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574652f-12c1-437d-b8b0-c268867363a6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.380220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574652f-12c1-437d-b8b0-c268867363a6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.383013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 353/716] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:00.386721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.387004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.387277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.391375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.392109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.392920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.393201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.393887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.394195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.395593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.411860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 364/717] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.417031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.419067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:00.420253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:00.522856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a8c68-3831-40cc-a3e8-6074a9439be5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.565799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.566377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.566659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.566931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.578080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.579556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.582226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 354/718] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:00.593818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:00.594721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:00.595718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 365/719] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:00.597805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.600970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.667689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.732337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07ebe-a762-4483-89f1-e3933bb54ba1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.767753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.768426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.768712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.768987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.769717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.770023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.771480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.783692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 355/720] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.789590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.895100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfd5ab-745c-4417-b25f-ecbc867f5482 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.930275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.930881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.931163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.931435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.932163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.932469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.933927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.939879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 366/721] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.024750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.198541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871a6b-bf2c-43e8-b5d7-019243e010b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.206934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.250203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.250842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.251122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.251964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.263799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-06d96989-13c7-41e4-96a1-d0209e90d714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:01.269022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:01.269992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:01.270860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 356/722] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:01.278613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.334597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f944b9-2152-4a0a-9224-955cbeabafb7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.334896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f944b9-2152-4a0a-9224-955cbeabafb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.335149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f944b9-2152-4a0a-9224-955cbeabafb7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.336725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 357/723] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:01.342815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.343102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.343372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.381099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:01.385980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:01.393852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.472425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079198-3f84-4fc9-b763-641863427429 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.525124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.525767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.526047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.526317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.526981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.527283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.530182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.534196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 358/724] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:59:01.545602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 367/725] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.547158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.675198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.682013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b799f-1485-4294-a1fa-b4170ffbfd44 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.727193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.727766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.728045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.728319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.744526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.746013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:01.761381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:01.762391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:01.763637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:01.763637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:01.763637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:01.763637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 359/726] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:01.768294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.931895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214dd9-aba6-41a4-a226-f1a97925f051 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.965285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.985016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.986468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.986938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.987417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.988256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.988741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.990323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.008776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 368/727] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.014685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.044534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.221829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00caf0-cc24-4d81-9fb2-1319d0d7ca23 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.237022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68afcdf-cf56-4645-9a1a-d4d2ced51f93 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.280808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.282337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.282974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.283518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.295101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:02.298726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.299660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.300051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.300329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:02.302372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.303294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:02.304145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:02.306826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 369/728] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:02.309536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.313004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.318981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:02.347914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.348954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:02.349993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 360/729] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:02.362777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.379581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.390000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.481933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3867c-c2b3-41ac-8d15-e0aa11dde4b3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.525253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26126-3cba-43a5-a802-34546c1e7b6d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.529366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.530351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.530894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.531419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.532386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.534025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.535421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944e6c-5d65-4f7e-823d-eecba4b6ff25 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.552750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 370/730] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:02.554820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de58d-ccd1-49b9-9390-4a1ad36dd34b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.555594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de58d-ccd1-49b9-9390-4a1ad36dd34b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.556526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de58d-ccd1-49b9-9390-4a1ad36dd34b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.558770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 371/731] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:02.559990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de58d-ccd1-49b9-9390-4a1ad36dd34b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.572343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.572948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.573232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.573528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.574280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.574580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.576355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1d30c-4f4f-47d2-b479-ef3351a93397 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.600671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 361/732] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.600671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.600671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.600671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.618543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:02.619756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:02.682714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.693532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 362/733] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:02.702429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.719156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de58d-ccd1-49b9-9390-4a1ad36dd34b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.734967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.778384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.779340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.779823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.780313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.799602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.801391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:02.836821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.837878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:02.839069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:02.839069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:02.839069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:02.841170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 372/734] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:02.847533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.847816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21eeb8-3604-4419-8506-7bd84eb29de4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.883056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.883838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.884256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.884587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.951105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.961467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.963100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.978000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38371-9034-4bc3-b9ea-74394a978236 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.016813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.018217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.018732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.019171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.019954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:03.020402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.022197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a7b52-1aa5-4e63-bc57-a95d6feb145f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.036087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 373/735] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:03.037304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e734-af27-43be-8d50-ca11ad22a30d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.037657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e734-af27-43be-8d50-ca11ad22a30d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.037936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e734-af27-43be-8d50-ca11ad22a30d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.039359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 374/736] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:03.043910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50e734-af27-43be-8d50-ca11ad22a30d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.063583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.080513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 363/737] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:59:03.080513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.173022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50e734-af27-43be-8d50-ca11ad22a30d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.182507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.190663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5c51-3975-4acd-ab8f-b02b9977509d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.210907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.211670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.211963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.212240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.212890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.214621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e944c48-28e5-400c-a4a3-0d4b38f191b8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.229700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.230361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.230637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.230909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.233133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 375/738] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:03 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:03.235161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.235514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.235818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.243276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.246527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.258377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:03.259624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:03.264626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:03.265704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:03.266664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:03.271778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 364/739] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:03.272997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.364977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 376/740] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:03 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:03.366642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.370531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.403181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f5e7a-066c-4e26-bb14-1d10a7afeafb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.444613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.445240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.445555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.445843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.458020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.459499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:03.475857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:03.476881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:03.478432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:03.478432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:03.478432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:03.478432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 365/741] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:03.482874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.492330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.497738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0f4cd-1c86-4c08-a6ed-69a6f7620839 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.542931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.543475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.543759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.544033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.545247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:03.545247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.546528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098373ad-df81-4b05-858a-01b5bf66edd5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.568487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 377/742] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:03.571725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2e0e-b03a-4e7b-bcfc-30b582eedecf None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.572180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2e0e-b03a-4e7b-bcfc-30b582eedecf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.572624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2e0e-b03a-4e7b-bcfc-30b582eedecf None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.574429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 378/743] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:03.575305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2e0e-b03a-4e7b-bcfc-30b582eedecf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.610261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248540c7-4ec3-4971-8a8a-8f2bf78ce9a1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.652567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.653161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.653451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.653759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.654708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:03.655451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.657257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c82d81-a63a-488d-8491-abd48f8198ef None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.661283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.675131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 366/744] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:03.676393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.676681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.676954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.702806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:03.703985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:03.709801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2e0e-b03a-4e7b-bcfc-30b582eedecf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.746838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.747454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.747736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.748010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.768266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.776534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 367/745] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:03 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:03.781696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.842838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.844684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.898397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe02ff9-bc9b-4797-89b9-21e8966823a3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.922585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.938138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.939690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.940438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.940908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.949869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.951525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:03.964053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:03.964994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:03.965901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:03.967919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 368/746] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:03.968806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.981237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 379/747] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:59:03.987312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.027712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.074186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c33686-cfce-4d66-a1d7-fa92df61645a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.100747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe4b9-e2c3-43ee-9cfb-78bf55eaef64 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.115554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.116168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.116449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.116720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.117368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.118765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.135907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 369/748] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:03 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:04.136732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.156255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.156883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.157162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.157434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.159313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.159623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.161103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.179622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 380/749] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:04.179622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.207668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.285652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfa77-f2db-4267-9777-05bff4828b6d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.306290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.308981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb75441-5ad2-4eb6-b798-36d60ae8fc10 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.330710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.331353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.331635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.331907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.345966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.347476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.349802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.350751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.351136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.351409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:04.363589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:04.364588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:04.365493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:04.365493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:04.365493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:04.368054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 370/750] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:04.369051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.370730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:04.377893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:04.378894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:04.379746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 381/751] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:04.380450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.492361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6d18-a52b-4e67-93bb-74a719dd230d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.532696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.533443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.533762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.534036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.534784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=33c9ac2314b84688b03c1e9f2924595b) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.535097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.536578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.549931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 371/752] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/role_assignments?user.id=33c9ac2314b84688b03c1e9f2924595b&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:04.551054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.608249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.623971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.656985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc0e1-d9f8-4355-8685-da5f4846bca3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.702710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343668ed-3701-49da-a3d2-607a3d971fe5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.710323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.711414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.711896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.712389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.713582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.714084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.715670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.740137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 382/753] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:04.746112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.748389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.749217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.749604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.749957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.750708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.751099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.757545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.764275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 372/754] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:04.771225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.881882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.890295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9b6c5-45fe-4f58-8361-dcc18f9ee175 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.949026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.949996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.950484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.951008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.969116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.971423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe919f-65d5-498e-b63e-2d2c5684fd87 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.974714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:05.003816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.004782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:05.005718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:05.005718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:05.005718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:05.007575 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 373/755] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:05.014615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.055047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.055737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.056020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.056284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.071106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.072574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.077983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:05.098933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.099927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:05.100924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 383/756] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:05.107762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.165827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bdea6-7529-4880-9d89-5b2ca66fc797 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.223750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.224370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.224653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.228376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.229072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.229389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.230816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.257076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 374/757] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:05.275009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.288578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5620b-c4a5-486a-bb73-5587b0608dad None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.298710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.328185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.328809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.329091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.330042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.330739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.331245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.332694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.346354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 384/758] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.352536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.419122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.459941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911211d5-8d66-4cf0-ad82-3f805318b8a2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.497069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.497866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.498152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.498428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.499275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=ba2b07df4c0a40ad851b598274877ed7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.499590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.501032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.507946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 385/759] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/role_assignments?user.id=ba2b07df4c0a40ad851b598274877ed7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.540804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef88c0-0a88-4917-a7e9-6c0ee231a02d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.591873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.592521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.592797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.593069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.601918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.603391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bcc8c43f-0886-446b-b24c-e074b328dfee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:05.616664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:05.618677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 375/760] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:05.623558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.762458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a862-7764-4b3b-9263-a1a85ae8a823 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.762636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a862-7764-4b3b-9263-a1a85ae8a823 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.762907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a862-7764-4b3b-9263-a1a85ae8a823 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.764425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 376/761] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:05.774050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.774382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.774604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.806108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:05.807336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:05.819732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd856-1f4e-4432-9f61-d0ad7ee9a71f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.860128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.882926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.889830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 377/762] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:05.893621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.894251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.894535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.894813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.895554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.895862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.897300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.932689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 386/763] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.938531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.050021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae7fb2-6472-4348-9efd-2800023d8846 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.085355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.086022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.086299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.086569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.103377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.104846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:06.121103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.123305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:06.125397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:06.125397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:06.125397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:06.125397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 378/764] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:06.128686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.209481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.281181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6ca1-3ced-4ae3-b44d-7778160a40cc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.297898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.356588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.357210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.357485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.357775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.358421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.358718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.360075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.390464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c42ca0-e073-43f3-90b2-2f4720d05f08 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.392020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 387/765] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.397867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.431117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.431756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.432300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.432568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.433147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.434538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.460592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.461660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:06.462510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 379/766] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:06.470453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.481844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.602450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b0069-f60c-4c6e-926a-2cad1fdc8f78 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.662664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9cc9-b0cf-4d8b-b460-f447848f85e5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.678294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.679271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.680153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.680628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.681148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.698635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.700471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.703320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.703950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.704234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.705050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.705732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] RBAC: Adding query filter params (name=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.706040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.707435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.717068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 380/767] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.723851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:06.729069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.730073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:06.730968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:06.734560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 388/768] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:06.740924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.841802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12e6d-dbe1-420d-8eae-ad31f715d84e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.854370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.857907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158524db-61b5-47e8-a5af-501b435f7134 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.881007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.881650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.881928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.882197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.882822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.883120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.884591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8e271-9f6a-4482-9e2e-6a6c5fc4ea94 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.889960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 381/769] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:06.891392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4aff9-85bf-4efd-804d-4d8448b42ce0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.891677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4aff9-85bf-4efd-804d-4d8448b42ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.892527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4aff9-85bf-4efd-804d-4d8448b42ce0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.894503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 382/770] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:06.896879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4aff9-85bf-4efd-804d-4d8448b42ce0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.901235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.901901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.902185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.902458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.903166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.903472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.904918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9fdc4-ebd5-4576-b91e-95082a62ae4b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.924496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 389/771] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.925869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.926263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.926545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.942396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.946704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:06.948120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:07.006741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4aff9-85bf-4efd-804d-4d8448b42ce0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.033752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 390/772] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:07.035044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.043302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.043915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.044193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.044465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.045269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] RBAC: Adding query filter params (interface=public, service_id=8b0d51b0c9334324b1c9657ec1cf1ebf, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.045603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.046963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.056505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 383/773] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/endpoints?service_id=8b0d51b0c9334324b1c9657ec1cf1ebf&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:07.063333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.143601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.154965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7e7d-9fc2-4bc1-a55a-5b2f732bfe74 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.192254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.192837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.193117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.193390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.195793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=b95c7c9fe9fa4536a3bcd298cfc7f9b7, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.197810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc6033-ba80-476e-9763-67a6c185d457 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.217832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 391/774] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:07 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:07.245133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b90c-9160-40c1-9ef7-08edc370a58f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.245470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b90c-9160-40c1-9ef7-08edc370a58f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.245752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b90c-9160-40c1-9ef7-08edc370a58f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.247453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 392/775] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:07.253238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.253603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.253838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.280840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:07.282127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:07.306080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f80d9-81d8-4318-83f8-46593d41d403 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.315875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.363113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.363777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.364064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.364340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.364986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.366428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.373928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 384/776] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/services => generated 772 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.374918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.393141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 393/777] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:07.502438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7bdd5-693a-4eb1-8b8d-1be490bdb5ab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.542537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.543303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.543590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.543936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.544544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.545979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.556581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.557684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:07.558529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 385/778] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:07.566524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.660906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.691923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0608-cdfe-4f54-bdf2-a2347fc1136f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.729633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.730299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.730580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.730901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.731549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.731851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.733214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.738830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 394/779] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:07.744431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.762428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.805899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.939189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d6e6-8444-4ebc-99f3-c889f92fd01f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.941634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc011c0-3943-4858-b77f-68e4eee74cca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.007275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.008259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.009137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.010021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.010521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.010991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.011457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.011928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.013267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.013993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.016996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.028686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 386/780] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.037422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:08.038602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:08.053126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.054193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:08.055057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:08.057428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 395/781] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:08.063520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.085249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.235147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e894e-3822-4c00-9294-e03c8789d4aa None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.241385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.253057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb829-0ebd-46d2-adbf-13a84c3a7ca0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.287474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.288005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.288343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.288621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.289296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.289642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.291008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04bd3-2524-4c27-917b-6fa5a1591de3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.296100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.297259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.297564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.297845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.299367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] RBAC: Adding query filter params (interface=public, service_id=d0a56abc94504d0da4a3e4ab2d190060, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.299681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.301055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7767d-1f6b-4d43-bac0-319492ab66b7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.301270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 396/782] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.302598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e6f-ce54-4213-b770-6bf1c22dafb9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.302886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e6f-ce54-4213-b770-6bf1c22dafb9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.303157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e6f-ce54-4213-b770-6bf1c22dafb9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.304350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 397/783] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:08.306524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa97e6f-ce54-4213-b770-6bf1c22dafb9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.311195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 387/784] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/endpoints?service_id=d0a56abc94504d0da4a3e4ab2d190060&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.312427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.312713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.312987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.339024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:08.340478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:08.386764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.419790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 388/785] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:08.421286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.434443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa97e6f-ce54-4213-b770-6bf1c22dafb9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.500834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.501784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.502143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.502487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.522291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.523753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.525098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.535566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8917f-bc33-4844-a5b5-b99f19fd25cc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:08.551307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.552268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:08.553162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:08.553162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:08.553162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:08.553162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 398/786] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:08.557953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.579468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.580516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.580999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.581894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.582722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.585089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.599225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 389/787] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.715893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97019-9d11-4d3e-8ed4-c23018770719 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.740549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.765915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.766553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.766867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.767140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.767792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.768096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.769469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.786150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 399/788] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:08.792064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.806727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.948601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c352b-647c-4d5a-94db-1e354c724266 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.956474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47110-7465-4a85-9f8e-535484abd676 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.993630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.994277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.994563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.994839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.003312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.003666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.003954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.004238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.004516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.005309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.016604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:09.019418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.020338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:09.021267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 390/789] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:09.026838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.028158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:09.029172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 400/790] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.033675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.036693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.048987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.113893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.215466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3a6c-1371-4371-871e-36de1df711d4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.217831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2766-a131-4ae1-915c-bcbc9f87bafa None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.284191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.284813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.285097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.285370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.286071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:09.286374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.287234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.287838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.288112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.288378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.289104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:09.289406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.290874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.293748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.303102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 401/791] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:09.317060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.324025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 391/792] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:09.326022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.403236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.443756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eeeef-aa52-497d-a36b-7b236ed41c79 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.479983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.480622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.480906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.481183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.492177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.494053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.507366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.512021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a35e-b007-4c64-9e1e-e4319c047a4f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:09.521550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.522555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:09.523448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:09.523448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.523448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:09.534071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 392/793] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.535547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.584960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.585630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.585975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.586258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.605796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.607267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:09.631612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.632619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:09.633543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:09.633543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.633543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:09.633543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 402/794] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.649368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.662121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865af57-e5a9-4df1-a63e-49dad5b1e7ad None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.686851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.700440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.701060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.701396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.701707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.702359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:09.702666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.704039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.723295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 393/795] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:09.724705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.844369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123d981-1614-4620-870a-d25ec877e99e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.884220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.885149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.885446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.885763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.893767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.895450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3f62cffd-9d72-4a9d-b983-90e10e415c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:09.910009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.910968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:09.911912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:09.913718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 394/796] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.915139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14245-b923-4920-8dea-d9399e8ab9f6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.915948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14245-b923-4920-8dea-d9399e8ab9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.917342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14245-b923-4920-8dea-d9399e8ab9f6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.919911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 395/797] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:09.922170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14245-b923-4920-8dea-d9399e8ab9f6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.925887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc204-ccd5-41fc-af48-48a4e8f1eac2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.966033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.966649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.966930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.967204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.967845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:09.968150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.970505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2a6c-a44d-4a34-b2db-655947651ced None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.975777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.988821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 403/798] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:09.990015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c2b-19a6-4a2f-bcfd-f05ed964789d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.990309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c2b-19a6-4a2f-bcfd-f05ed964789d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.990588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c2b-19a6-4a2f-bcfd-f05ed964789d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.993554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 404/799] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:09.993554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.993554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.993825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.011995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:10.013193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:10.021098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.043777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14245-b923-4920-8dea-d9399e8ab9f6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.081113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.081752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.082029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.082301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.082991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.083298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.093702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 405/800] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:10.093702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.093920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952ee32-a3b0-45e4-a808-9d59905a4305 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.200506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68623-9686-42ad-bbd4-2b5275f15516 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.232695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 396/801] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:10.234119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.234475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.234823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.239813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.240546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.240780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.241060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.248796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.250403 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.254830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:10.256144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:10.264105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:10.265079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 406/802] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:10.267001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.269486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.340486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 397/803] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:10.341699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.384698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7e43-7023-43a4-8073-b15f81c0c725 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.387911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.424691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.425531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.426027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.426406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/33c9ac2314b84688b03c1e9f2924595b/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.428696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=33c9ac2314b84688b03c1e9f2924595b, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.430353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.445615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 407/804] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:10 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/33c9ac2314b84688b03c1e9f2924595b/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:10.446627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.465364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144031a-6074-4127-80a2-989f4090cf6e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.509258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.510210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.510629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.511038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.511934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.512386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.514057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.523965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.539699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 398/805] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:10.541074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.575731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12bb9-00e6-4a68-8c4e-e3304116dac2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.617223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.618337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.618896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.619382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.632820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:10.639021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:10.639991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:10.640851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:10.644183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 408/806] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:10.654866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.655440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.665962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85426f36-b670-4423-a2e5-af706095b33b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.709769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.710787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.711380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.711659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.726256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.727634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:10.747228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:10.748256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:10.749155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:10.749155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:10.749155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:10.749155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 399/807] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:10.749407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.781740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03887993-63fd-49a4-a767-d9b40820d16f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.810481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.825066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.825713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.825989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.826256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.826923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.827211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.828567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.838002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 409/808] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:10.839134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.885358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e85a-6a8b-40ce-8cd7-99217bdb3f78 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.931471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.932523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.933243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.933713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.934447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.936432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:10.949012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:10.950256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:10.951369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:10.952272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43173d7-2a7c-43be-9011-e89692e6f081 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.960823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 400/809] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:10.961935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.977692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.991707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.992488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.992902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.993325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.994204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.994604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.996115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.010573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 410/810] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.011639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.065849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.090346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946326-b0d4-40b3-aadf-76cf076214e3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.132419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.133023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.133414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.133821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.139533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c685-7642-4833-a7cc-4006fb2e1588 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.146303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.147898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:11.164571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.165623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:11.166524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:11.166524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:11.166524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:11.170863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 401/811] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:11.171866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.185317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.186644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.187109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.187811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.188676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] RBAC: Adding query filter params (name=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.189397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.191611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.197756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 411/812] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.198718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.243621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.294401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd5ade-5f7b-4ea6-83a9-f30d51e8e350 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.331199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1a081-e1a5-464e-b9ab-fb0bdfca7319 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.338932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.340382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.340877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.341326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.342393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.352286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.357229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.372488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.373177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.373533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:11.373882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.374738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:11.375616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:11.376115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.376115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.376115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.377743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e14f-1650-428a-b412-33fde2cb339a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.378795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 402/813] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:11.379991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.390347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 412/814] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.392237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5566-6690-4303-a3c6-17ac08012d49 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.392669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5566-6690-4303-a3c6-17ac08012d49 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.393223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5566-6690-4303-a3c6-17ac08012d49 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.394831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 413/815] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:11.395617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b5566-6690-4303-a3c6-17ac08012d49 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.492314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36aed-1484-4352-9ae5-b0495cc7181e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.500533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b5566-6690-4303-a3c6-17ac08012d49 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.515053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.533535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.534244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.534616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.534980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.535613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.535910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.536813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.537393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.537535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.537792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.538060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.538956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.539561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.540969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383f5f8-8b94-4546-aafb-2a01fec91aef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.542082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 403/816] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.542848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.562318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 414/817] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.562318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.562318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.562318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.577573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:11.578810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:11.608252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.652892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 415/818] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:11.653803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.655851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2c73-4d6f-4ced-9ac0-f5aff200d224 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.695172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.695828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.696107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.696374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.704114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.705608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:11.717139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.718162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:11.719118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:11.725662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 404/819] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:11.725662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.775888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.790529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccbcd2-6d34-42f4-a0e3-df11e008247d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.834458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.835471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.836019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.836297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.837207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.839506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.841070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d540a2-94d6-4934-843c-0c17a0a256f7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.871694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 416/820] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:11.873002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.901957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.904856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.905811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.906088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.908316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/ba2b07df4c0a40ad851b598274877ed7/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.943858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=ba2b07df4c0a40ad851b598274877ed7, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.945414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.974292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 405/821] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:11 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/ba2b07df4c0a40ad851b598274877ed7/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:11.975154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.069199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db309ee-9a6d-451b-85a7-a09e12d9630e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.147542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.148175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.148452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.148723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.149469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.149820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.151261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.180796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.182493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 417/822] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:12.188280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.203258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644909-2ed5-4aa3-8eea-e9f6cf4e8a35 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.253904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.255192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.256183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.256908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.257721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.259942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.273543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.274580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:12.275417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:12.278502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 406/823] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:12.287051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.290823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.328101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81b7e-df38-4ad5-b73a-b0a38b8517b2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.386422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.387691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.388172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.388637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.430396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e086a2-cd07-4efb-b346-6901deaaab64 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.472749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.473373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.473701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.474023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.474662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.474967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.476443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.486065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 407/824] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:12.489105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.490693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.492273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.513770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.576023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.610054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 418/825] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:12.616442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.634558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d364c-e0d4-47ba-be11-be770f39dfd1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.681624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.682809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.683652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.684103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.685107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.685586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.687369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.699919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 408/826] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:12.700224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.737183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f69ec-f317-4def-b345-0ee9dd980455 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.786961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.788256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.788988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.789875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.806244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.808725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.811294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.832721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90202a7-681a-49ee-b040-37680e08502a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fc8f2a03-821e-47d9-9d31-17a799a8016f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:12.832940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.833885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:12.834785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:12.834785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.834785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:12.838809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 419/827] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:12.840082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bee7-0c4e-4f84-96b6-d4a8545482e7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.840365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bee7-0c4e-4f84-96b6-d4a8545482e7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.840633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bee7-0c4e-4f84-96b6-d4a8545482e7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.845598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 420/828] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:12.845598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1bee7-0c4e-4f84-96b6-d4a8545482e7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.870920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.872529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.873191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.873453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.873780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.874366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.875719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedb616-32ba-4cf3-ac58-b68f46e2f786 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.898963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 409/829] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:12.900647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.901000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.901350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.922603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:12.924254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:12.985253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1bee7-0c4e-4f84-96b6-d4a8545482e7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.013945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 410/830] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:13.030933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.031908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.032541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.033084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.033968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.034522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.036218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.049930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 421/831] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.055141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.139090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.175987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e1572-3990-4d28-aa70-80b28aa6141f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.211507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.212144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.212420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.212688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.220220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.221750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:13.233083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.234055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:13.234970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 411/832] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:13.240088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.306193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.336035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.363238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdb46a-43c4-4911-b5bb-fc3cba18e2ab None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.409831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.410517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.410886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.411248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.412566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.412967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.414953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.431582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 422/833] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:13.438486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.445184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a997f-5ae4-4bba-a12e-698dfc6940c2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.481957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.492948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.493826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.494284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.495232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.509354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:13.517647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.518777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:13.519830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:13.522849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 412/834] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:13.528199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.577764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53eb69-57dd-466a-b1c5-de377a56d4f9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.625561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.627335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.627802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.628530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.630163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.630661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.633176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.634877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9c9e-a150-42d9-8869-3dfe3373a626 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.650130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 423/835] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.681194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.681781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.682063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.682334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.683017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.683320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.684740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.695025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 413/836] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.700982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.706797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.824732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc875-9337-41ea-8bdf-bae1dfd43dde None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.864104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.865097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.865600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.866089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.878698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.880465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:13.896702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.897720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:13.898633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:13.898633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:13.898633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:13.899727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 424/837] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:13.905172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.962308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.013290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800065-5fe4-4668-928c-8b3cbcd8df29 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.049160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.049801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.050080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.050357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.051000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.051302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.052804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.065165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 414/838] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.070653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.133147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.184332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d9346-a318-4f0d-87b7-9b92b8aa2fec None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.222925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.223480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.223762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.224037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.231902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.233352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8a99a10d-8ea4-419f-bd32-309af1b1f32e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:14.245877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:14.247258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:14.248181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 425/839] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:14.253094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.293526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa27a4-58b6-4255-9d63-40e31ba2c113 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.293856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa27a4-58b6-4255-9d63-40e31ba2c113 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.294102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa27a4-58b6-4255-9d63-40e31ba2c113 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.295707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 426/840] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:14.301231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.301535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.301840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.323462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:14.326005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:14.372575 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be50f4-cfef-4b2b-8539-fe0023964d52 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.385352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.411796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 427/841] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:14.421555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.421555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.421555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.421555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.421944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.421944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.421944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.436035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 415/842] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.442212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.493964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.549403 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338bb68-25a0-4650-942f-48e5440f4745 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.584947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.585676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.586026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.586365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.656682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.659107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.710257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.714461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.789709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 428/843] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:14.795685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.844964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d154-e080-4c70-9749-ef487476d98c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.887536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.888672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.889158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.889772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.902487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:14.909416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:14.910394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:14.911259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:14.917971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea600-f054-45f5-9ede-adfbf3c8d2d7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.918557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 416/844] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:14.919547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.953610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.953898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.955271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.955791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.955944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.968179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.969991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.978450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:14.988425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:14.989612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:14.990742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:14.990742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:14.990742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:14.996534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 429/845] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:14.997660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.050461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80542faa-c73f-4121-af4f-c656db098eb4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.101531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.102410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.103450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.104152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.104982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.105564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.107188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.116277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102e99-dbaa-4595-bdc2-04659b607eef None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.123508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 417/846] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.123826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.164267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.165049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.165266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.165498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.166343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.166649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.168185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.186837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 430/847] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.187842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.238196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.249827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1aa0-25e4-4133-adda-a4138e536c72 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.256448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.294730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.295785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.296356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.296943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.299901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1f052-02a1-4b31-9e4b-bcd64a45cc6b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.311998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.314340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-20cf1db1-0410-4c51-8453-5e2a518bb69d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:15.332266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:15.333307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:15.334253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:15.334253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:15.334253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:15.334253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 418/848] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:15.334990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288d1f-af1d-4ae6-b716-1fa28114da73 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.334990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288d1f-af1d-4ae6-b716-1fa28114da73 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.335125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288d1f-af1d-4ae6-b716-1fa28114da73 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.336436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 419/849] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:15.340617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.341282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a288d1f-af1d-4ae6-b716-1fa28114da73 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.341391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.341583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.341852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.348895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.350391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e546c7e5-ac0e-40a0-8dea-df73203c236b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:15.361678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:15.367623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 431/850] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.368696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.369294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.389726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:15.390913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:15.461453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 432/851] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:15.461917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a288d1f-af1d-4ae6-b716-1fa28114da73 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.462374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.505701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.506593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.507024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.507482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.508304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.508787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.510370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.524395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 420/852] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.533554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.534139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.534551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.598181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a347b-60e8-4e06-ba30-dfc26dd5516c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.643152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.644755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.645035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.645306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.646029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.646334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.647766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.658448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb21efa-b28a-452c-9189-1b632e357900 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.665936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 433/853] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.666957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.696511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.697483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.698122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.698589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.706996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.708789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:15.723190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:15.725963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:15.727638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 421/854] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:15.731960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.781681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d263a-653d-4abf-a710-783673a29f36 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.792350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.805610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:15.818745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.819359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.819641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.819915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.820647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=33c9ac2314b84688b03c1e9f2924595b) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.820962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.822436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.829485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 434/855] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/role_assignments?user.id=33c9ac2314b84688b03c1e9f2924595b&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.830344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.860780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c555-b0ec-417a-9130-65c402fe06c7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:15.911978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eae9d-633e-434c-a644-112195987667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:15.912979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eae9d-633e-434c-a644-112195987667 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:15.913460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eae9d-633e-434c-a644-112195987667 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:15.913959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eae9d-633e-434c-a644-112195987667 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:15.914914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193eae9d-633e-434c-a644-112195987667 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:15.915414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193eae9d-633e-434c-a644-112195987667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:15.917106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193eae9d-633e-434c-a644-112195987667 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:15.938066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 422/856] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:15.944767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eae9d-633e-434c-a644-112195987667 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:15.977648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a32b60-def8-48dc-9a9f-97321b439931 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.015972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.017330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.017873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.018201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.018809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.020217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b0ba2601-d080-4d77-8e54-4aed4efd1eac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:16.029592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:16.030668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:16.031521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 435/857] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:16.033589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f36b-e489-470c-ad10-fd8c5260d6a2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.033589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f36b-e489-470c-ad10-fd8c5260d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.033799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f36b-e489-470c-ad10-fd8c5260d6a2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.037611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 436/858] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:16.037611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4f36b-e489-470c-ad10-fd8c5260d6a2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.077906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eae9d-633e-434c-a644-112195987667 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.081893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.107359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.123300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.123947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.124297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.124646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.157658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4f36b-e489-470c-ad10-fd8c5260d6a2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.194684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.195305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.195567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.195836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.195997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.196459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.196760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.197426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.198140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8cff2-6658-409a-a18f-c98af060cec8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.207811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 437/859] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.207811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.207811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.207811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.226059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:16.227235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:16.299563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 438/860] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:16.300370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.319586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 423/861] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:16.325093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.340656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.348066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.423147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dda67-d9e9-45e6-a977-a63ec62e913d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.434680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39121523-2dcd-4410-b495-da6606d96cca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.463062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.464393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.464850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.465295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.466120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.466597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.468225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.481674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.481674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.481674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.481674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.482713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 439/862] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.488199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.489715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:16.507310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:16.508326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:16.509484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:16.509484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:16.509484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:16.509484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 424/863] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:16.515118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.588131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.633872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.643995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47f8c-2102-400a-bafe-83fff2b60f95 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.674506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.698294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.698917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.699197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.699470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.700114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.700422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.702417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.713202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47228f71-d291-420e-a439-ea8ec3f0f891 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.718911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 440/864] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.725471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.750385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.750731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.751552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.751826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.752409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.753804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:16.763112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:16.764076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:16.765603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:16.769203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 425/865] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:16.770192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.878366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c84be-3cc6-43af-8bb1-ce7db2e4d2dc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.879550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96821e-8c8f-43d6-a3f5-d05e51043759 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.921638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.922240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.922520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.922945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.923766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.924075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.925398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.925715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.926481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.927202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.928017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.929104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.936126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 426/866] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.937280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.939792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.941680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:16.958061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:16.959151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:16.960252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:16.962695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 441/867] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:16.974449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.997993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:17.054932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d353-476a-423e-b834-9a8fbcd3a397 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.093144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.093867 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.094089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.094321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.096489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:17.096936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.098372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.113886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 427/868] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:17.120638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c18bf-013f-404c-b0fb-076e8f426eb5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.164156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.164797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.165080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.165352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.166123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:17.166432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.167926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df179-ff69-4af3-b67b-9c5f06e8dfcb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.183272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 442/869] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:17.190026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:17.262797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:17.304128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9f4a-d48c-4a0a-ae49-7f23a6392f15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.340968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.341988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.342505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.343010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.343933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=ba2b07df4c0a40ad851b598274877ed7) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:17.344459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.346243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c75f3-079c-4baf-8547-2bf526dd393c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.352846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 428/870] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:17 2022] GET /identity/v3/role_assignments?user.id=ba2b07df4c0a40ad851b598274877ed7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:18.149643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497671e8-7166-40bd-9917-5d42f9e9d37c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.150216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497671e8-7166-40bd-9917-5d42f9e9d37c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.150216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497671e8-7166-40bd-9917-5d42f9e9d37c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.151750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 443/871] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:18.157548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.158027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.158217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.177852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:18.179052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:18.247821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 429/872] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:18.517357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497671e8-7166-40bd-9917-5d42f9e9d37c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.597702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.628719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497671e8-7166-40bd-9917-5d42f9e9d37c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.663770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.664545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.664831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.665103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.665735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.667162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e66e54a8-5920-48aa-b684-aee94de5d637 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:18.677714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:18.678891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:18.680655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 444/873] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:18.685385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.748878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.791493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419ec41-35db-4b52-95f8-8cfeb75eb294 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.801244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2e84c-3264-497a-907c-98ce2c72041c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.801535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2e84c-3264-497a-907c-98ce2c72041c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.801817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2e84c-3264-497a-907c-98ce2c72041c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.803744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 445/874] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:18.809550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.809942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.810331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.833495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:18.834707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:18.838042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.839162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.839663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.840141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.840983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:18.841553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.843197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.848596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 430/875] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:18.853842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.929919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 446/876] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:18.968938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21486a7-ed6a-4915-a848-0df845ff6946 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.996599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.008439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.009290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.009702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.010076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.010808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:19.011294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.013201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03185399-7c45-4829-b026-e9c64692cb8b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.018798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 431/877] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:19.219028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.294297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.333141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefbc8-aabc-4ca0-bf6c-efe1bdbceaba None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.369256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.369823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.370116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.370382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.371047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.372420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6a1c-4766-4eb7-9f2f-11f2ea6e0674 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.379088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e73d4-d289-4e5d-883f-1b7375ab2744 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.379665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e73d4-d289-4e5d-883f-1b7375ab2744 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.379665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e73d4-d289-4e5d-883f-1b7375ab2744 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.380997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 432/878] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:19.387115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0de2-80e5-4779-b8fa-52603e3b3511 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.387399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0de2-80e5-4779-b8fa-52603e3b3511 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.387674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0de2-80e5-4779-b8fa-52603e3b3511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.388417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 447/879] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:19.407956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-501d0de2-80e5-4779-b8fa-52603e3b3511 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:19.409190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-501d0de2-80e5-4779-b8fa-52603e3b3511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:19.502288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 433/880] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:19.647780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a44752-18bb-47a7-84a4-4275f8f8d2a6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.647967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a44752-18bb-47a7-84a4-4275f8f8d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.648240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a44752-18bb-47a7-84a4-4275f8f8d2a6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.649923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 448/881] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:19.655252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.655550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.655827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.674853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:19.676040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:19.746792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 434/882] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:19.771681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a44752-18bb-47a7-84a4-4275f8f8d2a6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.880060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a44752-18bb-47a7-84a4-4275f8f8d2a6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.909775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.919850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.920453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.920728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.920997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.921776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.924890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.949750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 449/883] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:20.034639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.081707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.144248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9b09d-dcb7-4b1e-a091-aaba48dec632 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.190933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.191490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.191769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.192042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.202693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:20.208243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:20.209207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:20.210482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 435/884] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:20.215915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.324384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1f7f-ea6e-44f3-a167-01f2801e041c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.362129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.362755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.363036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.363458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.364135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.364443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.365860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.374845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 450/885] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:20.380928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.487620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.492173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154b530-5dbb-40cf-bea1-90a3a9341829 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.528120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.529052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.529535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.529990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.541646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.543342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:20.559050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:20.560037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:20.561025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:20.561025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:20.561025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:20.562873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 436/886] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:20.568402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.623364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.681320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909723f-c142-4df3-aef8-6d12a9b8b092 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.720933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.721584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.721868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.722419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.723083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.723465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.724872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.738469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 451/887] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:20.743740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.855640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4de5b-4ca5-4896-8a1f-fb289edf23c8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.891789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.892430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.892712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.893028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.900773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.902284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:20.913795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:20.914786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:20.916338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 437/888] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:20.920991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.027948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47881c5e-71f9-425a-af0b-42f762d896a8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.039132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.064329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.065001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.065284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.065578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.066318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:21.066621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.068047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea64195-520f-4cdd-8017-8c69cbf33f94 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.086410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 452/889] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:21.092240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.114803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.204433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f75ed0-5bac-41aa-8a5b-f9e14c9fd11b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.244340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.244980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.245265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.245573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.318332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.319712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.331238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.345295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a536-7585-4303-8d2b-ec5308bfeb0f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.345871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a536-7585-4303-8d2b-ec5308bfeb0f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.345871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a536-7585-4303-8d2b-ec5308bfeb0f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.347467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 453/890] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:21.352723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.353009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.353287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.371914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:21.373111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:21.426952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 438/891] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:21 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:21.434517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.456495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 454/892] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:21.546282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c01ba6-79aa-4549-b64f-eec43cf38351 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.558691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.584265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.585158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.585659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.586109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.597362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.599078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-579a5ce1-d036-48ba-aa5d-26bc9f94e214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:21.614707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:21.615713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:21.616612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:21.616612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:21.616612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:21.618431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 439/893] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:21.624211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.637530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9452a-af39-42b9-957b-0be4c680b906 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.637530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9452a-af39-42b9-957b-0be4c680b906 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.637530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9452a-af39-42b9-957b-0be4c680b906 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.637530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 440/894] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:21.641154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.642043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.642273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.662359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:21.664199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:21.739705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 441/895] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:21.749855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.754045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6f54-055e-4815-98cf-de2baa0606fa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.764428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.796686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.798227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.798953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.799415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.800878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:21.801531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.803200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.823069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 455/896] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:21.824723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.881499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.892037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2529ca-b16f-4a6b-9c7e-e3bd8b85dd26 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.931046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.931663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.932164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.932449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.933108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.935355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.947240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea81c6-4c59-462f-8442-aac4c3820399 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.960158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 442/897] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:21 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:22.004349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.005357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.005920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.006453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.014774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.017430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.028455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:22.032466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:22.033469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:22.034506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:22.037037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 456/898] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:22.044397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.064708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.174567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14411-c383-4650-b8a8-4d5867ec5f05 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.188677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9596-2a33-433a-b6dc-396802b56031 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.217340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.218334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.218619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.218891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.219519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.220889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.227855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.228463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.228798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.229073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.229833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.230141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:22.230962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:22.231928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:22.232776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:22.233571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.233649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 443/899] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:22.238929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.252883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 457/900] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.259158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.260903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.357761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe764-f656-4528-a87e-397d3080937d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.364388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.390537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b47fa-f49c-4be2-ae17-929522c2d642 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.401331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.402288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.402577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.403008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.403656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.403963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.405329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4657-29cb-4daf-b2da-36df7ac65ef0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.413579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 444/901] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.413579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f01b-b619-4f04-88de-a33395af66de None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.413579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f01b-b619-4f04-88de-a33395af66de None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.413579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f01b-b619-4f04-88de-a33395af66de None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.415812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 445/902] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:22.416885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f01b-b619-4f04-88de-a33395af66de None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.434286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.434839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.435106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.435380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.436228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] RBAC: Adding query filter params (role.id=b9e651315daf49ecb7b6047b958c39ad, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=ba2b07df4c0a40ad851b598274877ed7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.436539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.438223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a6ba1-227f-410a-be7a-e467c2993c9d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.450078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 458/903] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/role_assignments?user.id=ba2b07df4c0a40ad851b598274877ed7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=b9e651315daf49ecb7b6047b958c39ad => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.452253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.452772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.453280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.474080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:22.475420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:22.523147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.547143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f01b-b619-4f04-88de-a33395af66de None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.581682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 459/904] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:22.591615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.592244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.592525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.592854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.593573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.593884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.595370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.601667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 446/905] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.611594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.684845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.722167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50c4ef-d05b-4266-9c4b-314987acf627 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.762578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.763459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.763742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.764010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.764713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] RBAC: Adding query filter params (interface=public, service_id=962434bedeb5487ea33ea311f567f5f4, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.765081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.767259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.779928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 460/906] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/endpoints?service_id=962434bedeb5487ea33ea311f567f5f4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.781305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.865692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.889311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed727-7a87-4f6a-b2ae-4b9be2a01eb6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.925893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.926510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.926802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.927116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.927719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.929150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.941066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 447/907] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:22.998321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9d680-79cf-4d36-983c-b54b4ab56c5b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.033724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.040968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.042024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.042550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.043037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.043825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.045455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:23.055891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:23.056944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:23.057945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:23.060938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 461/908] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:23.070973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.086963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.193386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26097-064a-4c49-bb60-5bfb76e3bff6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.229249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.229950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.230236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.230507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.231197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.231503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.232874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.238380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 448/909] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.244180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.352312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58185-d924-4a0f-aa2b-73757e326667 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.388525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.390014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.390499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.391074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.392712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.393214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.394813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.400572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 462/910] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.406336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.480531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.513390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91461c8-6363-4edc-a207-b0b67ccf3c3e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.548185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.548833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.549061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.549335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.550060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] RBAC: Adding query filter params (interface=public, service_id=0f6266fc6575490dbacc7e32181618b4, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.550368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.551728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33380ff5-3a44-4bcd-b705-aa47a5fc3892 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.557050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 449/911] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/endpoints?service_id=0f6266fc6575490dbacc7e32181618b4&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.566564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.630340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.678659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471d5ae-27a7-4a5b-9006-afd72517c77a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.715467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.716537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.717046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.717563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.718374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.720474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8773-564f-4423-a3a0-f6fab4a1f2da None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.727708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 463/912] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:24.336389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2854-d85c-4aa3-986a-f83d0bf1117f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.337047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2854-d85c-4aa3-986a-f83d0bf1117f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.337581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2854-d85c-4aa3-986a-f83d0bf1117f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.339662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 450/913] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:24.345837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a140-7b1e-40f7-9547-dd54266db91c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.346401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a140-7b1e-40f7-9547-dd54266db91c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.346904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5a140-7b1e-40f7-9547-dd54266db91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.366592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f2f5a140-7b1e-40f7-9547-dd54266db91c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:24.368066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f2f5a140-7b1e-40f7-9547-dd54266db91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:24.444776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 464/914] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:24.713606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2854-d85c-4aa3-986a-f83d0bf1117f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.721832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032af7-5aeb-4a24-a524-188e7e8368b1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.722121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032af7-5aeb-4a24-a524-188e7e8368b1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.722400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b032af7-5aeb-4a24-a524-188e7e8368b1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.724018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 465/915] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:24.729272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.729543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.729797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.749375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:24.751265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:24.808975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.835655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 466/916] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:24.836948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2854-d85c-4aa3-986a-f83d0bf1117f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.876919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.877670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.878036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.878379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.879078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.880561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.883231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:24.890110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:24.891685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:24.893092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 451/917] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:24.900919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.007321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4d6f-737f-4fe7-83cc-24037a25430c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.044263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.045352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.045879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.046369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.047218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:25.047881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.049555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.059723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 467/918] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:25.061458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.109395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.163489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.201965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d5ba-5800-4cc1-a345-1cf0ac625d0e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.222491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e19c-6d65-43ef-a824-9f153f47d24d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.238568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.239157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.239432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.239699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.240319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:25.240619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.242015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce6c90-cb92-424c-9ccb-854fdf25bcfc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.246985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 452/919] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:25.248128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525086-365b-4308-88b8-fa7f3ec5eb9c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.248413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525086-365b-4308-88b8-fa7f3ec5eb9c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.248686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525086-365b-4308-88b8-fa7f3ec5eb9c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.250101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 453/920] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:25.253658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66525086-365b-4308-88b8-fa7f3ec5eb9c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.263074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.264432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.264870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.265308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.279458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c73a41cf-ec24-488b-b6e6-f380e5ab157b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:25.285545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:25.286680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:25.287684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:25.290129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 468/921] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:25.291524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.291945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.292352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.312385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:25.314009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:25.320747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.364804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66525086-365b-4308-88b8-fa7f3ec5eb9c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.386531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 469/922] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:25.387637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.405919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.407408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.408457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.409034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.410025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] RBAC: Adding query filter params (interface=public, service_id=8b148a53246442a69629ae3f626d10eb, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:25.410533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.412388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.418305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 454/923] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/endpoints?service_id=8b148a53246442a69629ae3f626d10eb&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:25.430453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.437110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.505897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e59d-850c-4dec-94a4-08d32e596fff None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.540260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb50a7-9944-45b2-89d5-c2d15d2bd13e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.544367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.545152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.545632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.546045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.546844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:25.548012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.549888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.559266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 470/924] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:25.565567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.570850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.580447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.581396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.581896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.582355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.583154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.584604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.597549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 455/925] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:25.684714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.687321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.691536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d9df-135d-4e13-ae83-86ec4d70d7f6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.734899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.735623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.735895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.736163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.747725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.749199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:25.770757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:25.771805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:25.772710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:25.772710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:25.772710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:25.772710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 471/926] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:25.778809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.817222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de8e7-299b-43cc-821d-75475d5999b5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.857441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.858112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.858394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.858664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.859247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.860646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:25.876299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:25.877383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:25.878744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 456/927] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:25.883302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.910514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb975a-6efb-40c5-9270-4589bbda6bbd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:25.947894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.950937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:25.951726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.952156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.952591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.953425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:25.954524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.956163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.969689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 472/928] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:25.977610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:25.994975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:25.997323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d78c2b-b02d-425d-b71b-dbde3c34297d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.037345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.038242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.038601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.038944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.039762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.040137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.041720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0ea2-f78d-4286-9f42-a9ba3a940dad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.046522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 457/929] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.048099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b550b-75af-4562-af09-c5b4af1a243b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.048387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b550b-75af-4562-af09-c5b4af1a243b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.048662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b550b-75af-4562-af09-c5b4af1a243b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.049927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 458/930] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:26.054692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b550b-75af-4562-af09-c5b4af1a243b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.102233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71783e-f1ea-410f-b766-cf37d54b1b15 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.138685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.139318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.139879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.139879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.148236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.149713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9d702291-ccf4-49dd-895a-9822e4f4301b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:26.162038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:26.163012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:26.163998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 473/931] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:26.165143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.165143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.165143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.173322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b550b-75af-4562-af09-c5b4af1a243b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.184238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:26.185619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:26.194499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.212327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.213618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.214335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.214761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.215658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.216104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.217630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.223051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 459/932] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.224004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.262324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 474/933] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:26.263149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.273921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.336793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17708145-73f6-48a1-8fc0-e0bb20c1153c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.373772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.374302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.374582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.374851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.376248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.377062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.378030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.400549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 460/934] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.401536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.404357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfc532-c682-4614-b3bd-4caf21a3b774 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.444323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.445407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.446029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.446498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.447321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.448221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.449878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.482455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 475/935] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:26.511752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611dd3-f44e-4a31-9e86-e8c87c02a237 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.545293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.561092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.561797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.562164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.562436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.575479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.577047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:26.595786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:26.596830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:26.597770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:26.597770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:26.597770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:26.597770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 461/936] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:26.605286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.629055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.685708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30c2e-8908-40c7-b8e0-f85c3c73cc0b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.729327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.730305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.730595 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.730871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.731455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.733790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.737394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:26.743984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:26.744976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:26.745938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 476/937] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:26.751563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f4ac-158a-4df1-931b-f9c3d23312cd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.753104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.789806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.790532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.790882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.791224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.791936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.792243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.793639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.811257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 462/938] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.814488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.874735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ebd7-8eab-4541-84ba-bdecb1565b39 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.899568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.912680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.913439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.913834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.914164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.914861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.915231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.916687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.924869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 477/939] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:26.928523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.933681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55628f69-f829-41bd-b0d2-d941387a3044 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.975345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.976441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.976819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.977186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.986562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.988561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:27.003037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:27.004155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:27.005229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:27.011434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 463/940] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:27.012925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.029430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.039930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a236bf5-74fb-4ab4-a70b-9782b27b104b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.087074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.088824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.089332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.090095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.091191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:27.091701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.094050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.104578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 478/941] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:27.110763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.160980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d11a-07f0-461b-b6e4-0b1dee6d9741 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.177545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.208952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.210615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.211137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.211622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.212588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:27.213171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.215114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.233554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86634c2b-8814-49ac-9d67-d0aa3b769600 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.236170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 464/942] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:27.238154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.272013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.272769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.273123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.273496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.274274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.275881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e4654-e0e2-4a23-b218-bba76914733a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.301003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 479/943] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:27.320561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.357233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8567-7094-4c9f-b884-701169fc2d0e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.405201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.405921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.406204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.406547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/ba2b07df4c0a40ad851b598274877ed7/roles/b9e651315daf49ecb7b6047b958c39ad` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.409113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=ba2b07df4c0a40ad851b598274877ed7, role_id=b9e651315daf49ecb7b6047b958c39ad)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.410622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2013f7-6c68-4879-a279-a194e4ba821d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.427839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 465/944] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:27 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/ba2b07df4c0a40ad851b598274877ed7/roles/b9e651315daf49ecb7b6047b958c39ad => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:27.924715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f06f-b012-4729-8a6a-c0d617effae9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.925890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f06f-b012-4729-8a6a-c0d617effae9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.926424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f06f-b012-4729-8a6a-c0d617effae9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.927952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 480/945] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:27.933687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.934118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.934315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.953176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:27.955260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:28.026261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 466/946] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:28.299565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f06f-b012-4729-8a6a-c0d617effae9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.408863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f06f-b012-4729-8a6a-c0d617effae9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.415930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.444748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.445377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.445684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.446063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.446647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.448011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:28.457825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:28.459049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:28.460155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:28.463678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 481/947] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:28.465974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.523495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.570003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60af38-bcb4-496c-8d2a-5ed038d2bbcc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.604902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.605532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.605823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.606100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.606731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.607033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.608464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.614244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 467/948] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.619935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.732156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a7be3-4a04-4cbc-afd2-38e3da149371 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.771673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.772633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.773109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.773601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.774449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.774959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.776531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c5a-38c9-4cb3-bd03-6560ea18f667 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.787118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 482/949] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.788711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.833910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590495a9-fb19-4ae9-8e5b-05638ddec3ed None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.834548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590495a9-fb19-4ae9-8e5b-05638ddec3ed None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.834820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590495a9-fb19-4ae9-8e5b-05638ddec3ed None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.836484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 483/950] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:28.842169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.842454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.842726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.861207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:28.862744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:28.895286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.916825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa20b-8511-4678-9d0f-bc907e80cc58 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.944154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.944869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 484/951] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:28.961107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.961953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.962375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.962787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.963959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.965455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.993673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 468/952] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:29.225115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.333640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4f2b-f581-4f54-97a9-695e87039534 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.377851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.378817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.379306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.379799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.380669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.382331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.385164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING keystone.server.flask.common [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 29 01:59:29.403851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.sql.core [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:29.403851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 29 01:59:29.403851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [parameters: {'id': '497c24392e6e4ac7b146b0b3376d4e2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 29 01:59:29.403851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 497c24392e6e4ac7b146b0b3376d4e2a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 497c24392e6e4ac7b146b0b3376d4e2a. Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:29.422695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 29 01:59:29.423590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application yield resource Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise self.value Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application session.commit() Sep 29 01:59:29.424563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:59:29.425498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:59:29.426452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:29.428806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [parameters: {'id': '497c24392e6e4ac7b146b0b3376d4e2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.431164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:29.433427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 497c24392e6e4ac7b146b0b3376d4e2a. Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:29.435807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 485/953] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Sep 29 01:59:29 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:29.437446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.556832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94dc7-240f-4c2b-949d-28b8edfa2c9d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.595234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.596248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.596746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.597239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.604557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.606309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-634cbf1c-9b43-44bb-8f36-fffbfe8037e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:29.619673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:29.620685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:29.621703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:29.624200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 469/954] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:29.630556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.651493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572edcb-0d78-43ce-bc8e-d59cb2257236 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.651787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572edcb-0d78-43ce-bc8e-d59cb2257236 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.652075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572edcb-0d78-43ce-bc8e-d59cb2257236 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.652342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.653699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 470/955] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:29.658406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245eee-202f-4548-bfab-7b89d1e35886 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.658682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245eee-202f-4548-bfab-7b89d1e35886 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.658969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245eee-202f-4548-bfab-7b89d1e35886 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.660330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 471/956] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:29.661247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55238e-96d4-440b-bfcb-6371c8e3f789 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.661559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55238e-96d4-440b-bfcb-6371c8e3f789 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.661866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55238e-96d4-440b-bfcb-6371c8e3f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.681127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ec55238e-96d4-440b-bfcb-6371c8e3f789 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:29.682355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec55238e-96d4-440b-bfcb-6371c8e3f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:29.714778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.745170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004db5b-3115-469a-b39b-fc4d09a6c1eb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.759640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 472/957] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:29.761839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.762343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.762788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.785227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.785974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.786327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.786679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.787459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:29.787788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:29.787897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.789256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:29.789741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.816482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 486/958] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:29.871019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 473/959] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:30.056623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.140491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.165377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.166438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775d054-5ab0-4384-be19-1bc625652dcd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.216641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.217295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.217605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.217886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.218479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.220737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:30.232899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:30.234176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:30.235398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:30.237586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 487/960] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:30.241398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.286086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.292141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8911d-97d9-4d9a-bae1-d403f5f85856 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.336766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.337322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.337681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.337960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.349544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:30.354508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:30.355564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:30.356718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 474/961] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:30.362038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.380074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51b72-ad97-4fe6-a282-474de3f39722 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.416604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.417219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.417499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.417798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.418429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.418733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.420110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.432266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 488/962] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:30.440478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.442946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.483362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81575-b71f-43b0-8a64-4d774191f3c8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.523043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.523653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.523936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.524212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.524875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.525180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.526590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.535885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 475/963] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:30.541191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.561911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.575640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229dbf-7e00-47d4-ae58-a4068d2baa8b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.613994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.615034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.615577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.616091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.616922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.617450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.619048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.629692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 489/964] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:30.649833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ad5a0-4f46-4b68-8d43-f56832a4b5f7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.690566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.691225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.691503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.691775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.705817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.707304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:30.724885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:30.726910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:30.729103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:30.729103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:30.729103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:30.729103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 476/965] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:30.732800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.811896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.856081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf615dd-7cbb-4f54-bd1e-b24b480d31a0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.894475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.895317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.895769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.896192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.897001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.897523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.899049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.916630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 490/966] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:30.922445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.005908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.035904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb22e8-8fc1-4dca-9266-7d894fc8383a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.075733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.076662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.077097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.077542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.086437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.088142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:31.104073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:31.105230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:31.106267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 477/967] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:31.111597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.226913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4c74-be94-4f9e-a9c2-3e3512fd7cae None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.258449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.267789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.268404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.268683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.268955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.269793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:31.270095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.271528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160cd49-b6e9-41a0-b30e-f0e2d2b813ed None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.291812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 491/968] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:31.298240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.358221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd245-9fd8-44f0-ad23-b02814778197 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.359043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd245-9fd8-44f0-ad23-b02814778197 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.359723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd245-9fd8-44f0-ad23-b02814778197 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.362487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 492/969] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:31.368910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.369752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.370238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.394529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:31.396411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:31.414797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619583f3-c5c2-42e9-af56-4bfa45abeb8a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.450337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.459090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.460580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.461119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.461933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.497656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 493/970] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:31.550403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.551859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.667074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 478/971] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:31.674027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.803187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd224d-2dae-418e-bb0e-c64f7e4001d3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.822989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.823993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.844922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.845619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.845899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.846182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.856838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.858350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.858469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:31.874484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:31.876082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:31.876996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:31.876996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:31.876996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:31.876996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 494/972] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:31.882522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.947167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4158-50c0-4327-8bba-982be0129f21 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.991647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcab5a8-6f7f-4c1e-a39c-53fd247decc1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.993527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.995232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.995584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.995921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.996581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.998507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:32.012257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:32.014439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:32.017015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 479/973] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:32.022858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.037112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.038075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.038512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.039073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.039939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.040393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.042247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.059141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 495/974] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:32.065638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.105604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.168296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.178761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce2d1c-4dc5-4219-b025-33714b7bd0fa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.202636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908ded-862d-4c43-a572-fc154be0422b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.224448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.225392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.225920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.226640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.227869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.228403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.230023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f1f7e-d93f-4962-a755-186e75511c66 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.235603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 480/975] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:32.236650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0375a-f7d5-4dbf-9918-1c13fa7cbb06 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.236936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0375a-f7d5-4dbf-9918-1c13fa7cbb06 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.237211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0375a-f7d5-4dbf-9918-1c13fa7cbb06 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.238567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 481/976] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:32.240834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0375a-f7d5-4dbf-9918-1c13fa7cbb06 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.248766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.249693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.250274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.250796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.258885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.260875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6c0a21c8-5f7f-4794-a64f-d52c53eaf650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:32.274242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:32.275159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:32.276099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.278214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 496/977] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:32.279608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.280027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.280448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.300357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:32.301831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:32.345133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0375a-f7d5-4dbf-9918-1c13fa7cbb06 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.384155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 497/978] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:32.384155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.388789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.389904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.390189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.390468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.392308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.392764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.394449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.398732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.402627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 482/979] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:32.408675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.436584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.498404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611de0c-d8ed-490d-9869-0725fcbc611c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.538099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.538797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.539142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.539483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.539952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78484f86-c038-4730-a9fd-36f6dbf22049 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.540313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.540675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.542199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.560590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 498/980] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:32.562250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.587930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.589163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.589669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.590687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.591862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] RBAC: Adding query filter params (interface=admin, service_id=8b148a53246442a69629ae3f626d10eb, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.592349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.595079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.602572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 483/981] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/endpoints?service_id=8b148a53246442a69629ae3f626d10eb&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:32.609209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.655747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.681562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74fea3-471d-4eab-952c-21a2e8e4dc0a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.717923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.718931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.719392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.719886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.720778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] RBAC: Adding query filter params (role.id=b9e651315daf49ecb7b6047b958c39ad, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=ba2b07df4c0a40ad851b598274877ed7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:32.721272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.723132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.727015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.730435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 499/982] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/role_assignments?user.id=ba2b07df4c0a40ad851b598274877ed7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=b9e651315daf49ecb7b6047b958c39ad => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:32.731404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.763795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a071-804a-4f41-9957-f7b1b1b7188b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.819225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.820091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.820449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.820794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.821531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.823245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.839735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 484/983] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/services => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:32.869562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46a223-3e7b-4e2a-9cf5-59edfab56230 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.914679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.915334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.915621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.915898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.916585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.918175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.935528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.sql.core [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:32.935528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 29 01:59:32.935528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [parameters: {'user_id': '6fdf7b48d70744a89272df1e521b9b51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 29 01:59:32.935528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0ec5e774-7570-4c36-b65f-4e6a934e024c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:32.943892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:32.944898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application yield resource Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise self.value Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application session.commit() Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:59:32.945894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:59:32.946790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:32.947688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:32.948549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [parameters: {'user_id': '6fdf7b48d70744a89272df1e521b9b51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:32.949385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 29 01:59:32.952529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:32.955438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 500/984] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 29 01:59:32 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:32.956930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.025893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8ee9-e03a-4266-8925-59b33ad5ab9f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.026225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8ee9-e03a-4266-8925-59b33ad5ab9f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.026456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad8ee9-e03a-4266-8925-59b33ad5ab9f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.031088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 501/985] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:33.036890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.037179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.037462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.045874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.058930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:33.060475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:33.076196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbf696-81a1-4ce9-8414-451db6b801d1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.120412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.120961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.121237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.121520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.130759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.132373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:33.146682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:33.147684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:33.148632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 485/986] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:33.154047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.159166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 502/987] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:33.169653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.267041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c5e44-3ed9-4838-9ee4-62456db24574 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.301786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.302398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.302682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.302953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.303647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:33.303946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.305495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49599-fd87-4d44-a4d4-8c601f5349c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.343817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 486/988] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:33.434131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.549362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a120-a7f3-4011-90cc-9339644d74d0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.586724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.587347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.587630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.587907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.588838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.590411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d546-fed8-425b-a611-1bbc6a78ec01 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.594477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.608915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 503/989] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:33 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:35.066288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d4aa-8f56-4fe5-8b71-becaaaca0d6a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.066821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d4aa-8f56-4fe5-8b71-becaaaca0d6a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.066821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d4aa-8f56-4fe5-8b71-becaaaca0d6a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.068333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 487/990] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:35.073365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.073799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.074002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.075937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b86b0-d744-4624-b112-9f72d76f7572 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.076224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b86b0-d744-4624-b112-9f72d76f7572 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.076503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b86b0-d744-4624-b112-9f72d76f7572 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.077899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 488/991] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:35.082842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.083131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.083407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.092488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:35.093726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:35.106987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:35.108515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:35.175407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:35.176882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 504/992] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:35.185543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 489/993] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:35.446550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.448487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.550264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997667c-d1f7-4a84-a15a-a1488a3bd238 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.556768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b638-de0f-496c-a146-eca5699b8cdd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.571356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:35.591180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750468-0990-4664-abbf-2f9158817230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.592452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750468-0990-4664-abbf-2f9158817230 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.592922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750468-0990-4664-abbf-2f9158817230 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.593404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750468-0990-4664-abbf-2f9158817230 None admin] PATH_INFO: `/v3/services/image` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.595106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82750468-0990-4664-abbf-2f9158817230 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.596002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.596640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.596923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.597199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.597478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82750468-0990-4664-abbf-2f9158817230 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.597813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.599174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-82750468-0990-4664-abbf-2f9158817230 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:35.607720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:35.608733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:35.612007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:35.612836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:35.613777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:35.614622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 490/994] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:35.615443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 505/995] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:35.616778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.617979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750468-0990-4664-abbf-2f9158817230 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.688438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:35.727570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750468-0990-4664-abbf-2f9158817230 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.736242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd355b8-1a90-4c23-a3ea-2cd9c57d1e94 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.762761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.763376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.763652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.763979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.764611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] RBAC: Adding query filter params (name=image) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:35.764916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.767057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5e1d1-a110-40e5-9b8d-86ac09016652 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.772032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 506/996] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:35.778179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.778334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581beb3-f08c-4c9f-8ddb-4d2f6a656ef2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.778479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581beb3-f08c-4c9f-8ddb-4d2f6a656ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.778760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581beb3-f08c-4c9f-8ddb-4d2f6a656ef2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.778881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.779050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.779317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.779940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:35.780028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 507/997] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:35.780243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.780747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581beb3-f08c-4c9f-8ddb-4d2f6a656ef2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.781849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5675978-9776-411c-8f8d-ae00edd86f39 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.787071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 491/998] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:35.788466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.788754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.789029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.807290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:35.808476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:35.832854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:35.877300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 492/999] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:35.878109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.884907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581beb3-f08c-4c9f-8ddb-4d2f6a656ef2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.919724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.920326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.920605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.920876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.921496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] RBAC: Adding query filter params (type=image) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:35.921822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.923853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.929381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 508/1000] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:35.955937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.007535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b31ad-2451-47b1-9df2-6779af51052e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.043445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50105-e843-4222-b846-c7622c430269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.044077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50105-e843-4222-b846-c7622c430269 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.044361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50105-e843-4222-b846-c7622c430269 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.044638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50105-e843-4222-b846-c7622c430269 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.045290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50105-e843-4222-b846-c7622c430269 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:36.045628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50105-e843-4222-b846-c7622c430269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.047576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50105-e843-4222-b846-c7622c430269 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.057796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 493/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:36.059363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.148966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50105-e843-4222-b846-c7622c430269 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.178689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110059-5c2f-425a-823a-af1e9a42907d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.192452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.217043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.217681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.217960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.218229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.219518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.221232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.249538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 509/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:36.270573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50105-e843-4222-b846-c7622c430269 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.293480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.318154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.318796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.319071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.319340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.319919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.321294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:36.331932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:36.333026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:36.333927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 494/1003] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:36.339668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.454241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e71f5-87f9-4b60-acb2-bd1faf7e333b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.488901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.489536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.489815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.490160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.490785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:36.491086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.492438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.497462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 510/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:36.503872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.606616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8468e71-3aa2-4cf3-b6fa-79f0a6af006b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.641440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.642338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.642621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.642892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.643518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:36.643819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.645180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.655059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 495/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:36.657140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.693783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.767092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152121b-6407-4175-937e-5f9e70a32d50 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.801799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.802417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.802794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.803069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.803760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] RBAC: Adding query filter params (interface=public, service_id=ff385ec51fe14f8ea145ec473a6e98be, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:36.804173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.805652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0251f7-f141-49d5-bcf4-b45ffab9db17 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.816098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 511/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/endpoints?service_id=ff385ec51fe14f8ea145ec473a6e98be&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:36.817355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.871371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.927341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9943089-a948-4030-9e28-14e9e9b577dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.960394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.961002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.961283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.961580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.962183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.963799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f5bdb-ce76-4988-a04a-2fa8768e2b62 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.977556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 496/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:38.116920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a098-5b82-496c-9a72-2ae046f55f61 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.117416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a098-5b82-496c-9a72-2ae046f55f61 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.117552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a098-5b82-496c-9a72-2ae046f55f61 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.118832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 512/1008] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:38.124279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cdbbb-28f8-4641-aead-154a7e81e81f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.124707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cdbbb-28f8-4641-aead-154a7e81e81f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.124911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cdbbb-28f8-4641-aead-154a7e81e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.143916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-095cdbbb-28f8-4641-aead-154a7e81e81f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:38.145100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-095cdbbb-28f8-4641-aead-154a7e81e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:38.214840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 497/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:38.468561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319808-3072-497d-a9ef-c3ca7a271870 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.468818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319808-3072-497d-a9ef-c3ca7a271870 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.469296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319808-3072-497d-a9ef-c3ca7a271870 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.470807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 513/1010] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:38.475849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.476142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.476416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.485793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319808-3072-497d-a9ef-c3ca7a271870 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:38.494780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:38.495966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:38.526967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:38.566443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 498/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:38.591902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:38.596891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319808-3072-497d-a9ef-c3ca7a271870 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:38.631792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:38.632446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.632727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.633000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.633669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:38.635026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:38.657556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 514/1012] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:38 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:38.837802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:38.942687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb593244-6bef-4524-9373-b081ef1b7e33 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:38.984518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:38.985151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.985433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.985729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.986836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:38.988273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0d8fd-1591-4ca2-82b2-4d192f0350a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:38.993548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 499/1013] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:38.995587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.112886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7cd6a-c255-4a5f-a5a0-8902cd8f5b49 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.149359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.150171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.150358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.150630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.152464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.152816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.153050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161c27-e189-41cf-9bdb-b458f8f0cb26 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.153428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161c27-e189-41cf-9bdb-b458f8f0cb26 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.153707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161c27-e189-41cf-9bdb-b458f8f0cb26 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.155022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 500/1014] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:39.160732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.161024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.161305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.181089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:39.182546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:39.193548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 515/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:38 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:39.212666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.260945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 501/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:39.533455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.549315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.639822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e86b-7c22-4708-bf2c-889de4a946c2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.674616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.675247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.675531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.675807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.676384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.677788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:39.686442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:39.687523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:39.688431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:39.692610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 516/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:39.693682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.798689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d112789-ceab-44ee-b932-28709f9f1ad4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.832933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.833565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.833853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.834128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.834750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:39.835052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.836417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.846872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 502/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:39.848073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.930919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.956315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d40eb-53ad-4587-88ce-2d3fc3f1f0dd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.993201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.993858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.994141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.994413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.995041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:39.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.996704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19646d8-67fc-4c3c-af66-97ac8a6b1fa1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:40.006856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 517/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:40.008340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:40.036140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:40.112854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34bdd-0c2b-4a9f-9fe5-5e5e0834a1a1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:40.150576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:40.151194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.151475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.151748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.152415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:40.153807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07f1b8-4312-45ca-a07c-a5debb718084 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:40.181537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 503/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:40.890425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d4d2-10e2-47b8-82bf-495bc3200581 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.891026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d4d2-10e2-47b8-82bf-495bc3200581 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.891026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d4d2-10e2-47b8-82bf-495bc3200581 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.892371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 518/1021] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:40.897760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e2af-0a54-4787-b912-3b91a7a077e2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.898124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e2af-0a54-4787-b912-3b91a7a077e2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.898471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e2af-0a54-4787-b912-3b91a7a077e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.917362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9a23e2af-0a54-4787-b912-3b91a7a077e2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:40.918586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9a23e2af-0a54-4787-b912-3b91a7a077e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:40.993077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 504/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:41.266372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d4d2-10e2-47b8-82bf-495bc3200581 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.372608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d4d2-10e2-47b8-82bf-495bc3200581 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.407896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.408623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.408907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.409184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] PATH_INFO: `/v3/services/image` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.409799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.410260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dca3-d841-4fbc-b2d3-2a339120a584 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.410686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dca3-d841-4fbc-b2d3-2a339120a584 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.410914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dca3-d841-4fbc-b2d3-2a339120a584 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.411166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.412369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 505/1023] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:41.417492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.418051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.418533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:41.420309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:41.421321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:41.422272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 519/1024] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:41.427297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.431901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.441748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:41.442941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:41.444930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.518122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 506/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:41.540708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196042b-abf3-485d-a0f9-1ca90caeb327 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.575151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.575766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.576051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.576329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.576956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] RBAC: Adding query filter params (name=image) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:41.577261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.579337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.584399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 520/1026] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:41.590655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.690029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36191a3-c883-40aa-821c-6386a83d1428 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.724107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.724710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.724988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.725254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.725928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] RBAC: Adding query filter params (type=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:41.726229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.727641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.732458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 507/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:41.739120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.797618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.800405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.809918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.845195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279564c-a480-48fd-81fa-40ac7a060474 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.880617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.881228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.881499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.881799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.882489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] RBAC: Adding query filter params (interface=public, service_id=d7291b9f4f8f4c55b86178f9d1bb9e75, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:41.882796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.884156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.889135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 521/1028] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/endpoints?service_id=d7291b9f4f8f4c55b86178f9d1bb9e75&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:41.895968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.906801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc89bed-2284-4549-ab4d-aeb4b5995d87 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.943131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.943760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.944042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.944325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.945414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.946881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.948586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 508/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:41.954609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.007010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab813ab-7392-4d44-a1f5-f9be2bdc886d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.027474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.041888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.048549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.049095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.049377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.049680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.050285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.051652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affabec5-6ab9-4f1e-8c2a-370e62e5c714 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.065555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 522/1030] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 01:59:42.070754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080471f-1141-4540-9f0c-0a675b88bfd4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.111164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.111788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.112073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.112347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.113014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.114495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e629d54-aaf6-4d8a-a05b-405f05c7174d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.138266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 509/1031] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:59:41 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:42.471077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89960654-73f8-4d3d-b07a-b5b0420e1fdf None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.471415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89960654-73f8-4d3d-b07a-b5b0420e1fdf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.471654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89960654-73f8-4d3d-b07a-b5b0420e1fdf None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.473117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 523/1032] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:42.478177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.478613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.478792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.497567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:42.498981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:42.567322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 510/1033] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:42.833626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89960654-73f8-4d3d-b07a-b5b0420e1fdf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.948289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89960654-73f8-4d3d-b07a-b5b0420e1fdf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.986955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.987994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.988504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.988992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.999554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:43.004780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:43.005760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:43.006654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:43.009664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 524/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:43.012996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.069107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.122983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8bf0-caff-4303-a521-dec418425509 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.157611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.158213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.158489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.158756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.159410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:43.159709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.161060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.168985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 511/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:43.174896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.232389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.277190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b7a4-9593-4e47-ba23-a7dba682c4d8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.310634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.311260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.311537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.311806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.322270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.323705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:43.339310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:43.340301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:43.341213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:43.341213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:43.341213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:43.345266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 525/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:43.346280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.445850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b26-a92a-41d2-a727-0a4314597f80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.462411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.480409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.481051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.481275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.481576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.482216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:43.482519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.483871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.501424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 512/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:43.502731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.599773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958486fb-2296-47d3-bc16-6c44f4b22336 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.608343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.634743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.635362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.635637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.635905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.643250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.644681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:43.655655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:43.656915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:43.658445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:43.661540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 526/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:43.662515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.761002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d277-3ce2-48a9-8ca7-768b0312b239 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.796024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.797209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.797610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.798061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.798789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:43.799091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.800509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.822667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 513/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:43.823927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.924493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea051d-2d53-40de-b0a4-bb6bf9074201 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.958880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.959517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.959817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.960021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.995082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.030444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.032106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f3e68-677f-40e7-af8f-8f639f287b4f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.139784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 527/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:44.141454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.179270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.244506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001c175-a4d6-4128-ba5a-3fe21d184c0b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.270773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201973d5-049d-418c-b1de-d6c88340768f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.271075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201973d5-049d-418c-b1de-d6c88340768f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.271337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201973d5-049d-418c-b1de-d6c88340768f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.272966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 528/1041] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:44.278868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ff7a-e32d-47c4-8613-5ccaddb01332 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.279206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ff7a-e32d-47c4-8613-5ccaddb01332 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.279429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ff7a-e32d-47c4-8613-5ccaddb01332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.281902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.282567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.282915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.283250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.295823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.298319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.299201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e6e1ff7a-e32d-47c4-8613-5ccaddb01332 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:44.300449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e6e1ff7a-e32d-47c4-8613-5ccaddb01332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:44.314786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:44.320604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:44.321796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:44.321796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:44.321796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:44.321796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 514/1042] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:44.321796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.376679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.384879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 529/1043] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:44.391131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbd9a5-b2f7-49ea-a5c2-bf811267b0e2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.391479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbd9a5-b2f7-49ea-a5c2-bf811267b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.391920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbd9a5-b2f7-49ea-a5c2-bf811267b0e2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.393881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 530/1044] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:44.398853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.399145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.399424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.416030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.418905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:44.420136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:44.429740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed836b-1be9-494a-b5d7-ec25635a2f25 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.465666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.466272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.466555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.466894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.467871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:44.467871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.469945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.482098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 515/1045] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:44.487677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.500205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 531/1046] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:44.589100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15347a-bb56-4749-8d9e-8c0ca3879958 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.624377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.625036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.625323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.625650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.632410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.633874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:44.645146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:44.646229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:44.647164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:44.649954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 516/1047] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:44.651917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.652049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.664869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.758076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9830-cc19-48ff-aeea-8ab938a6bd03 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.764415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f668d-f655-42a7-b841-e061962025b8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.785401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.793761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.794373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.794652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.794924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.795608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:44.795912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.797540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.798957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.799607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.799868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.800144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] PATH_INFO: `/v3/services/image` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.800721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.802123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.809160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 532/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:44.809968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:44.810714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:44.811674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:44.814582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 517/1049] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:44.816143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.886586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:44.912652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102d88-f8f4-4f56-880a-58f18939ca38 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.917743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6bed-cd08-4a3f-837b-ef007bdcbc93 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:44.946196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.946822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.947101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.947371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.951222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:44.951820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.952099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.952372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.953352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] RBAC: Adding query filter params (role.id=b9e651315daf49ecb7b6047b958c39ad, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:44.953756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:44.955188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:44.957913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:44.960386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 518/1050] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=b9e651315daf49ecb7b6047b958c39ad => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:44.962330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:44.963052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:44.964749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:44.966250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 533/1051] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:44.971084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.026921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.094120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554f25d-41a3-43ba-84d7-e6404335f984 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.100717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e0af-a862-4e61-ac83-390b6a6b6000 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.133246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.133894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.134179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.134455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.135094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.135398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.136986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.138702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.143978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 519/1052] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:45.149287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.152530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.153340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.153699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.153970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.154632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.154931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.156700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.166336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 534/1053] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:45.172860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.259390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280fdf-97a6-44ab-b7e9-589407fa1ac1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.283207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4a49d-8f82-44e0-870d-a0a3986a097e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.293883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.298369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.299467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.299804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.300167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.300797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] RBAC: Adding query filter params (type=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.301099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.302711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.308106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 520/1054] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:45.313437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.323117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.323758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.324042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.324319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] PATH_INFO: `/v3/users/0145337c8074483a8351d08e8243aea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.338633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] RBAC: Authorizing `identity:get_user(user_id=0145337c8074483a8351d08e8243aea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.340079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.341731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 535/1055] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/users/0145337c8074483a8351d08e8243aea8 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:45.348076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.387666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.431247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51536-60bd-4b7f-a1f0-535237e0c8ae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.452365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1099dd2-2410-4cea-8687-07e7bb81b5c9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.469375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.470065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.470344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.470791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.471277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.472650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.489699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.490408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.490689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.490960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.494760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 521/1056] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:45.538529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.578669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.580157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.689587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 536/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:45.695190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.808781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ee43-80ec-4003-9373-48811d9359d6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.824888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.847103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.847839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.848122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.848423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.849688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.851173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8173a-484a-4885-b898-6f79bda1ff20 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.853058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 522/1058] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:45.859271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.926320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.961549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e76ab-2a35-4f9f-8e1d-237cbb4922ca None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.996005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.996630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.996882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.997153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.998032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=baead73df7e9412ba6b39bdf1c134622, user.id=0145337c8074483a8351d08e8243aea8) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.998345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.000318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddd910-089c-4d52-a370-20bf483759e4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.010655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 537/1059] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/role_assignments?user.id=0145337c8074483a8351d08e8243aea8&scope.project.id=baead73df7e9412ba6b39bdf1c134622&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:47.136247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729eee-208e-4efc-b017-99e5a93a141f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.136247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729eee-208e-4efc-b017-99e5a93a141f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.136247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729eee-208e-4efc-b017-99e5a93a141f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.136247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 523/1060] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:47.142292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.142771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.143030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.162045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:47.163310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:47.232020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 538/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:47.504535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729eee-208e-4efc-b017-99e5a93a141f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.607413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729eee-208e-4efc-b017-99e5a93a141f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.644758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.645399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.645711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.645991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.657293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-64dc3e89-1269-45a9-8165-ff58d6525aff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:47.662133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:47.663089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:47.664050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:47.665854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 524/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:47.669337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.732165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1a61-98d8-4338-977d-5cc6df1cb2fb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.732502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1a61-98d8-4338-977d-5cc6df1cb2fb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.732721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1a61-98d8-4338-977d-5cc6df1cb2fb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.735480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 525/1063] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:47.735600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.739967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.740250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.740522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.759174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:47.760269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:47.776553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11879425-9228-455b-ac2a-5f78edabec80 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.802719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.814441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.815146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.815496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.815844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.816582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:47.816964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.818429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.826616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 539/1064] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:47.833035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.833253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 526/1065] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:47.935657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3f28-2a12-44c3-b543-6e0218b79847 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.959334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.971706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.972426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.972777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.973121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.984405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.986073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:48.000791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:48.002003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:48.003141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:48.003141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.003141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:48.005824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 540/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:48.009138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.099770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.125839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37995227-81f9-4320-b5f1-4e3d9f51e8ea None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.163210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.163853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.164082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.164349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.164974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:48.165271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.166660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8ac9-3efc-40a4-9f78-fa14f9e760eb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.178425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 527/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:48.179588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e507-7a2f-452e-9373-bb23fb4d6135 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.179872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e507-7a2f-452e-9373-bb23fb4d6135 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.180142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e507-7a2f-452e-9373-bb23fb4d6135 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.181319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 528/1068] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:48.183843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e507-7a2f-452e-9373-bb23fb4d6135 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.205679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5460-119e-4e7b-bcfb-14e7832e82d1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.219932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.246258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.246879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.247161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.247433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.289258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e507-7a2f-452e-9373-bb23fb4d6135 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.293528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.317128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.318617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.322988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.323617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.323896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.324167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.332099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.333560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4870e878-6109-4ad1-b61e-bd52814274a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:48.345071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:48.346133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:48.347156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 529/1069] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:48.347852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.347928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.348213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.365206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:48.366350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:48.421350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 541/1070] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:48.422282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.435055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 530/1071] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:48.436093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.468118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.504017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.534483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dacbe-3c73-4100-9ea5-dc778400f354 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.548551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e4b43-9cd6-40ad-90e6-59788dbfc81c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.571309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.571924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.572209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.572493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.573243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:48.573583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.575007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.591323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.592081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.592436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.592779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.595567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 542/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:48.601052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.603654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.605093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:48.620649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:48.621847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:48.622777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:48.622777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.622777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:48.622777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 531/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:48.628101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.710540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.711722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d2b6-999a-4fa1-b270-6052b037fdfc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.735242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58079d-08be-4ace-8aac-ac0002263822 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.746476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.747100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.747380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.747652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.750075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.759036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.760506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.769836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.770443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.770725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.770998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.771638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:48.771943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.773300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:48.774855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:48.775838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:48.776773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:48.776773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:48.776773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:48.776773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 543/1074] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:48.776773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.792377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 532/1075] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:48.792377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.897130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35af6e-a38f-494e-b5e2-25265d36ef09 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.912079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d1195-37e8-4715-9b30-f801a3c835af None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:48.933434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.934119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.934406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.934670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.947765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:48.952685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:48.953704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:48.954571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:48.955249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:48.955348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 544/1076] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:48.955425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:48.955425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:48.955425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:48.955425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:48.955691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:48.957246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:48.959407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:48.959972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:48.972264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 533/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:48.979192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.011847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.072996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9803-5e0c-4f42-8d7a-19457b80e786 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.092561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac0654-371b-4ecc-9959-b6021b7c7cab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.115320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.115934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.116213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.116486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.117149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:49.117455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.120816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.128732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 545/1078] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:49.134910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.136432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.137063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.137418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.137697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.144744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.146201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:49.157835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:49.158804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:49.160191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 534/1079] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:49.164411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.219892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.237846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26f82e-121d-4e54-9591-0ef3eb752d0d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.247522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.268712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37dcbb-d2f2-4ac1-838d-5a053729ea6e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.272145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.272770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.273049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.273320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] PATH_INFO: `/v3/users/0145337c8074483a8351d08e8243aea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.274477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] RBAC: Authorizing `identity:get_user(user_id=0145337c8074483a8351d08e8243aea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.275897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.277454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 546/1080] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/users/0145337c8074483a8351d08e8243aea8 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:49.283805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.302593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.303202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.303481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.303754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.304438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:49.304760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.306199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.318436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 535/1081] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:49.324248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.385574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0867-6134-48b6-b99f-1062ace1493a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.419487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.420035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.420313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.420581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.421797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444768b5-f5d2-44cd-91cb-808b8078242a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.421925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.423366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.424970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 547/1082] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:49.431359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.438048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.457437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.458121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.458401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.458677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/b9e651315daf49ecb7b6047b958c39ad` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.460798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=b95c7c9fe9fa4536a3bcd298cfc7f9b7, role_id=b9e651315daf49ecb7b6047b958c39ad)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.462244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553430b-a6f0-43fa-b691-7e6c1c770bbf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.475118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 536/1083] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:49 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/b95c7c9fe9fa4536a3bcd298cfc7f9b7/roles/b9e651315daf49ecb7b6047b958c39ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:59:49.477799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.542782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb1da-a5c2-471e-8fdd-d19dce7ca6a3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.579809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.580487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.580769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.581042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622/users/0145337c8074483a8351d08e8243aea8/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.583017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=baead73df7e9412ba6b39bdf1c134622, user_id=0145337c8074483a8351d08e8243aea8, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.584497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462cfa7-ba18-4dae-be0e-aea6e40361b3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.598539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 548/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:49 2022] PUT /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622/users/0145337c8074483a8351d08e8243aea8/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:59:51.654332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bbf2-732a-44bc-9aba-fa8cfd32b336 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.654910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bbf2-732a-44bc-9aba-fa8cfd32b336 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.654910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bbf2-732a-44bc-9aba-fa8cfd32b336 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.656449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 537/1085] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:51.662441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3bf-f2fb-4097-bd80-9bc189232df9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.662969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3bf-f2fb-4097-bd80-9bc189232df9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.663073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3bf-f2fb-4097-bd80-9bc189232df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.681686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fc3cc3bf-f2fb-4097-bd80-9bc189232df9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:51.682874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fc3cc3bf-f2fb-4097-bd80-9bc189232df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:51.752502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 549/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:51.752945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd70-a7b7-4643-a94a-8741c3a3b176 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.753234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd70-a7b7-4643-a94a-8741c3a3b176 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.753528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128fd70-a7b7-4643-a94a-8741c3a3b176 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.754853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 538/1087] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:51.760032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.760323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.760597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.778176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:51.779342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:51.805311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:51.845566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 550/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:52.025018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128fd70-a7b7-4643-a94a-8741c3a3b176 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.121742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.128896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128fd70-a7b7-4643-a94a-8741c3a3b176 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.162860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.163519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.163803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.164077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.175256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:52.180063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:52.181201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:52.182364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 539/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:52.187522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.221978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0875-51c7-4b10-8550-ca69e398965b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.222185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.256657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.257295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.257615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.257894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.268354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:52.273131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:52.274161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:52.275085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 551/1090] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:52.280172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.288818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d4ae-26e5-4be4-a640-2fc80e9220db None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.305406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.322730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.323419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.323710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.323991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.324650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:52.324952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.326356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.334748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 540/1091] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:52.340737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.384949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cb7ce-f40b-4fe2-b6f3-3a6a48a8a8f3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.420244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.420848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.421132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.421679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.422470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:52.422779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.424139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.432227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 552/1092] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:52.434753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.438418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.438653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97cae7-c154-47bf-9260-c63b9200e691 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.474159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.474783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.475059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.475327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.486219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.487725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:52.502529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:52.503705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:52.504646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:52.504646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:52.504646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:52.504646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 541/1093] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:52.509257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.524455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.540009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ff57-8b6e-4cb5-a410-0738b072568b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.574800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.575430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.575707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.575983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] PATH_INFO: `/v3/users/0145337c8074483a8351d08e8243aea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.577104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] RBAC: Authorizing `identity:get_user(user_id=0145337c8074483a8351d08e8243aea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.578733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.580303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 553/1094] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/users/0145337c8074483a8351d08e8243aea8 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:52.586037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.611010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72e23-29b4-40fa-92af-4f67a85fb72b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.645898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.646515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.646776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.647042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.647673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:52.647970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.649316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.661636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 542/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:52.667227 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.679290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.688911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0f70-b54f-4aa7-bdca-8655b4cec738 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.722978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.723583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.723864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.724136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.748374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.767666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe6e3-ba36-492f-8040-2f115732b3b7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.792780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.794193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.801563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.802191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.802469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.802738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.809606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.811019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:52.823185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:52.824187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 01:59:52.825156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 543/1096] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:52.830580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.897345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 554/1097] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:52.898719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.903802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.930669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150e5d-4f28-4591-9316-da7103d55f60 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.957816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.965648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.966259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.966544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.966821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.967545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:52.967853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.969279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.986555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 544/1098] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:52.992237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.007920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786903-f295-4d79-8b83-7399f1352dd0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.041407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.042056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.042333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.042601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.043749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.045113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.046815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 555/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:53.053236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.091121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76076-4a43-4f32-b6ce-d5343711d57d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.119468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.128909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.129534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.129830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.130103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.153413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d6ad0-85ca-41c2-bde9-e22d42e98088 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.175496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.189243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.190025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.190300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.190570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.191283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=baead73df7e9412ba6b39bdf1c134622, user.id=0145337c8074483a8351d08e8243aea8) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:53.191591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.193002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.196850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.198318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.198875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 556/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/role_assignments?user.id=0145337c8074483a8351d08e8243aea8&scope.project.id=baead73df7e9412ba6b39bdf1c134622&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:53.302945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 545/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:53.308781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.413427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e1f7-1e56-4497-afee-ce3049d1a24a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.447084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.447711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.447987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.448256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.458463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.459902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:53.474490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:53.475628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:53.476559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:53.476559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:53.476559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:53.476559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 557/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:53.481579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.508987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.582577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6890f-860f-4629-af40-efecf40ef58e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.617489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.618116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.618397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.618670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.619311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:53.619615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.620971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.632172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 546/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:53.637836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.678897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.742421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3abf6-696d-44e4-bee8-203dd502d19d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.776638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.777262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.777572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.777852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.785046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.786517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:53.798193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:53.799266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 01:59:53.800593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 558/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:53.805076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.891630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.903914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a387c3-c491-4fb6-a71c-28b58ba3500b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.936986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.937675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.937912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.938188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.938884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:53.939190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.940620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a234-cc9f-40d7-aefb-f69ed9e0816c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.953221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 547/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:53.959369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:54.053283 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:54.057330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366ac9e-d7cb-4f48-a6f7-82dc8a3527d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:54.090643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:54.091276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:54.091580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:54.091822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:54.092567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] RBAC: Adding query filter params (role.id=b9e651315daf49ecb7b6047b958c39ad, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:54.092873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:54.094642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df1b50-93b7-47b8-8c7e-e4cd2fe13dde None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:54.102102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 559/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/role_assignments?user.id=b95c7c9fe9fa4536a3bcd298cfc7f9b7&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=b9e651315daf49ecb7b6047b958c39ad => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:55.385083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdcff-4efd-4e2e-a643-6be11bc0a11f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:55.385628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdcff-4efd-4e2e-a643-6be11bc0a11f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:55.385628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdcff-4efd-4e2e-a643-6be11bc0a11f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:55.386902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 548/1107] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:55.392649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:55.393034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:55.393201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:55.411458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:55.412623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:55.476113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 560/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:55.747295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdcff-4efd-4e2e-a643-6be11bc0a11f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:55.846428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdcff-4efd-4e2e-a643-6be11bc0a11f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:55.879137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:55.879752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:55.880033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:55.880304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:55.881404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:55.882866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f7ae2-e4f0-4b9c-b364-0e3f61f4cba1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:55.884451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 549/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:55.890942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:55.977389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:55.986379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d47a9-5b10-4646-9072-c12d3beea4c8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.019967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.020504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.020783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.021053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.021715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.023125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa81e-f4c4-48be-a557-54d2319664b7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.043540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 561/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 01:59:55 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:58.227447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07772b-fe80-44a2-b87c-457bcf70b313 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:58.228002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07772b-fe80-44a2-b87c-457bcf70b313 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:58.228002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07772b-fe80-44a2-b87c-457bcf70b313 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:58.229432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 550/1111] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 01:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:58.235502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:58.235926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:58.236058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:58.254321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:58.255506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:58.320952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 562/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:58.588457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07772b-fe80-44a2-b87c-457bcf70b313 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:58.606996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:58.688214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07772b-fe80-44a2-b87c-457bcf70b313 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:58.721348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:58.721988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:58.722270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:58.722540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] PATH_INFO: `/v3/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:58.723895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] RBAC: Authorizing `identity:get_role(role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:58.725252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:58.726571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 551/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:58 2022] GET /identity/v3/roles/ec1eab75eebd4484b004466d3dede7cb => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:58.732406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:58.808041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:58.830154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277f00-8751-4339-a597-caaed25ecf11 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:58.862630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:58.863236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:58.863521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:58.863789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] PATH_INFO: `/v3/users/0ec9a83dd8e64174b77fc083f97613c3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:58.877314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] RBAC: Authorizing `identity:get_user(user_id=0ec9a83dd8e64174b77fc083f97613c3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:58.878770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:58.880326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 563/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:58 2022] GET /identity/v3/users/0ec9a83dd8e64174b77fc083f97613c3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:58.886115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:58.968157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:58.983785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd451-e54c-495d-b6e0-20d810a112c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.017871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.018472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.018772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.019030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.083844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.085281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.165256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:59.181716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 552/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:59.188693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.284597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07df7e-9d55-40c5-8ebe-c8ef705494a3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.318501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.319116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.319394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.319663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.320752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.322199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb421-29ed-4e3f-89ce-a84d1cf86b4e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.323764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 564/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:59 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:59.330180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.425378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a832d4-94e7-4cde-b5cf-abd66244df2a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.457983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.458573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.458850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.459117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.459854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=baead73df7e9412ba6b39bdf1c134622, user.id=0ec9a83dd8e64174b77fc083f97613c3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:59.460156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.461615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815545-d8a6-4e74-8b8a-788f60228bd0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.466902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 553/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:59 2022] GET /identity/v3/role_assignments?user.id=0ec9a83dd8e64174b77fc083f97613c3&scope.project.id=baead73df7e9412ba6b39bdf1c134622&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:01.571353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadfad-5832-448f-943b-f56a3e29f90d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:01.571860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadfad-5832-448f-943b-f56a3e29f90d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:01.571860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadfad-5832-448f-943b-f56a3e29f90d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:01.573179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 565/1118] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:01.578386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44424-8926-41d4-9e04-272244aae31f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:01.578810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44424-8926-41d4-9e04-272244aae31f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:01.578934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44424-8926-41d4-9e04-272244aae31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:01.596846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-29d44424-8926-41d4-9e04-272244aae31f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:01.598042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29d44424-8926-41d4-9e04-272244aae31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:01.640207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:01.662477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 554/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:01.938768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeadfad-5832-448f-943b-f56a3e29f90d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:01.942603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:02.039146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeadfad-5832-448f-943b-f56a3e29f90d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.072138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.072762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.073043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.073319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] PATH_INFO: `/v3/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.074725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] RBAC: Authorizing `identity:get_role(role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.076098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.078065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 566/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:01 2022] GET /identity/v3/roles/ec1eab75eebd4484b004466d3dede7cb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:02.083876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d44424-8926-41d4-9e04-272244aae31f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.179393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d44424-8926-41d4-9e04-272244aae31f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.212078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.212639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.212926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.213457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] PATH_INFO: `/v3/users/0ec9a83dd8e64174b77fc083f97613c3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.214597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] RBAC: Authorizing `identity:get_user(user_id=0ec9a83dd8e64174b77fc083f97613c3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.216019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.217629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 555/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:02 2022] GET /identity/v3/users/0ec9a83dd8e64174b77fc083f97613c3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:02.223421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.291079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:02.321377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e49955-03df-4d2a-ba72-1941667a597c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.353899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.354519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.354801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.355075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.356180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.357635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d422b-aa6c-4511-8fc4-131f741f908f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.359784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 567/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:02 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:02.365760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.411022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:02.461767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80cc5c-f702-4e5c-897c-4f7c8719fd75 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.494967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.495548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.495828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.496103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622/users/0ec9a83dd8e64174b77fc083f97613c3/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.498203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] RBAC: Authorizing `identity:create_grant(project_id=baead73df7e9412ba6b39bdf1c134622, user_id=0ec9a83dd8e64174b77fc083f97613c3, role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.499738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7090c-fe67-45ac-91e3-e5e12f16751e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.511719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 556/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 02:00:02 2022] PUT /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622/users/0ec9a83dd8e64174b77fc083f97613c3/roles/ec1eab75eebd4484b004466d3dede7cb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:04.642908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ad9b-175c-4e59-b39f-f84487b5c988 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:04.643434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ad9b-175c-4e59-b39f-f84487b5c988 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:04.643434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ad9b-175c-4e59-b39f-f84487b5c988 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:04.644765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 568/1124] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:04.650071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:04.650481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:04.650623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:04.669020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:04.670237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:04.741420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 557/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:05.012887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9ad9b-175c-4e59-b39f-f84487b5c988 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.114303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9ad9b-175c-4e59-b39f-f84487b5c988 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.147437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.148063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.148346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.148622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] PATH_INFO: `/v3/roles/ec1eab75eebd4484b004466d3dede7cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.150034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] RBAC: Authorizing `identity:get_role(role_id=ec1eab75eebd4484b004466d3dede7cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.151395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.152692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 569/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/roles/ec1eab75eebd4484b004466d3dede7cb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:05.158462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.192004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:05.255321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8666-d13e-49fb-999c-32719de75c0b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.287590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.288154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.288438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.288714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] PATH_INFO: `/v3/users/0ec9a83dd8e64174b77fc083f97613c3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.289855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] RBAC: Authorizing `identity:get_user(user_id=0ec9a83dd8e64174b77fc083f97613c3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.291287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.292843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 558/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/users/0ec9a83dd8e64174b77fc083f97613c3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:05.299413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.310435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:05.396454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48c0d-0c00-45fb-9fbf-6874385ffc22 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.428553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.429146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.429423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.429720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.493686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.495440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.505085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:05.590573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 570/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:05.596911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.693048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf4e0a-f4e3-497b-99f5-559e14563e8d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.695291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:05.726166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.726783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.727064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.727336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] PATH_INFO: `/v3/projects/baead73df7e9412ba6b39bdf1c134622` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.728437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] RBAC: Authorizing `identity:get_project(project_id=baead73df7e9412ba6b39bdf1c134622)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.729881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d1d4-3196-45bb-8088-c92778f0f489 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.731474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 559/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/projects/baead73df7e9412ba6b39bdf1c134622 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:05.738347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.831987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610975f-f483-4c95-b098-de688eb0798d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.841014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:05.866229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.866818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.867093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.867361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.868080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] RBAC: Adding query filter params (role.id=ec1eab75eebd4484b004466d3dede7cb, scope.project.id=baead73df7e9412ba6b39bdf1c134622, user.id=0ec9a83dd8e64174b77fc083f97613c3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:05.868368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.869800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facf948-4e33-4576-bb6d-b2e51f942b80 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.875261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 571/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/role_assignments?user.id=0ec9a83dd8e64174b77fc083f97613c3&scope.project.id=baead73df7e9412ba6b39bdf1c134622&role.id=ec1eab75eebd4484b004466d3dede7cb => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:08.055772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae157-0126-4a92-aa2f-022f801867a1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.056311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae157-0126-4a92-aa2f-022f801867a1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.056311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae157-0126-4a92-aa2f-022f801867a1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.057660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 560/1131] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:08.063071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.063496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.063646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.081696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:08.082870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:08.148392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 572/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:00:08.422498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae157-0126-4a92-aa2f-022f801867a1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:08.521179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae157-0126-4a92-aa2f-022f801867a1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:08.554548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:08.555156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.555440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.555707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.556791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:08.558231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf95e4b-9f47-49bc-ac47-6c756af76812 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:08.559743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 561/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:00:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:08.565393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:08.661836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054574-7e63-4bdf-8db5-4d0b2a17e825 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:08.663299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:08.697122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:08.697693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.697978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.698254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.698913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:08.700343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ea3f-80d5-4cb9-a5c6-cc0005b18c69 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:08.726965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 573/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 02:00:08 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:10.876208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3a18-acc5-4499-bd97-3195698349b7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:10.876742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3a18-acc5-4499-bd97-3195698349b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:10.876742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3a18-acc5-4499-bd97-3195698349b7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:10.878120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 562/1135] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:10.883334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:10.883802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:10.883896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:10.901583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:10.902763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:10.966708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 574/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:11.238983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3a18-acc5-4499-bd97-3195698349b7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:11.281830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:11.337740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3a18-acc5-4499-bd97-3195698349b7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:11.370178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:11.370787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.371062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.371330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.372410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:11.373896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206176c-fac9-4e50-88b6-7b28343ca822 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:11.375396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 563/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:00:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:11.381121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:11.465381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:11.482200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420ead5-c0bb-43ae-9579-c27fd299915d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:11.515687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:11.516223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.516504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.516777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.517416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:11.518874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c4bf1-2e26-4dba-9c84-fcceffe0420b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:11.539816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 575/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 02:00:11 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:13.705475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1346-5d58-4395-9426-00fdb43233a5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:13.706036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1346-5d58-4395-9426-00fdb43233a5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:13.706036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1346-5d58-4395-9426-00fdb43233a5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:13.707382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 564/1139] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:13.712543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:13.712935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:13.713364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:13.732459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:13.734407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:13.799011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 576/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:14.066174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1346-5d58-4395-9426-00fdb43233a5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.166249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1346-5d58-4395-9426-00fdb43233a5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:14.175435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:14.199220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:14.199840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.200121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.200397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.210841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:14.215851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:14.216959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:14.218718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:14.221660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 565/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:14.223826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.290560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:14.321693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f9c3-3e79-401b-86db-1cce9ff2e1c0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:14.355340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:14.355933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.356213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.356482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.357166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:14.357530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:14.359150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:14.366907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 577/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:14.372786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.471467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71097ebd-cd7f-4eab-a9fa-464a13616ce2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:14.504517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:14.505131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.505411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.505716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] PATH_INFO: `/v3/users/81be6b9ff52248769c68da4193af2a72` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.518806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] RBAC: Authorizing `identity:get_user(user_id=81be6b9ff52248769c68da4193af2a72)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:14.520244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:14.521836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 566/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/users/81be6b9ff52248769c68da4193af2a72 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:14.527491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.624845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6573-f5f3-43f2-bd34-c748eafbda4c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:14.652935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:14.658343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:14.658943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.659224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.659496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.725333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:14.726813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:14.820858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 578/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:14.827338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.853456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:14.922281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029003d-8d35-4829-a066-703f4350a70e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:14.954754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:14.955368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.955644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.955914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] PATH_INFO: `/v3/projects/4991a2feac0d4261b33d2989fea45372` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.957001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] RBAC: Authorizing `identity:get_project(project_id=4991a2feac0d4261b33d2989fea45372)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:14.959549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c973f-121a-4277-bc53-10a63b0cbea6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:14.960058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 567/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/projects/4991a2feac0d4261b33d2989fea45372 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:14.966379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:14.996252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:15.062939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d704940-e3e3-41bc-b77e-b8dbec288b35 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.095788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.096399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.096681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.096955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.097711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=4991a2feac0d4261b33d2989fea45372, user.id=81be6b9ff52248769c68da4193af2a72) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:15.098022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:15.099918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365a0cc-0db9-4689-b043-a35768a40589 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:15.105004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 579/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:14 2022] GET /identity/v3/role_assignments?user.id=81be6b9ff52248769c68da4193af2a72&scope.project.id=4991a2feac0d4261b33d2989fea45372&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:17.256694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f2d4-1965-426d-8e20-fee98801e3af None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.257249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f2d4-1965-426d-8e20-fee98801e3af None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.257249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0f2d4-1965-426d-8e20-fee98801e3af None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.258580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 568/1147] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:17.264349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.264776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.265018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.283280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:17.284484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:17.348452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 580/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:17.624016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0f2d4-1965-426d-8e20-fee98801e3af None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:17.715586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:17.723524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0f2d4-1965-426d-8e20-fee98801e3af None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:17.756071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:17.756690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.756973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.757249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.767591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:17.772397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:17.773486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:17.774639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 569/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:17.779635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:17.805168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:17.875944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcac75-e997-4048-8921-cfd3e773d38e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:17.908156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:17.908748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.909034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.909305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.909987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:17.910289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:17.911644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:17.919288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 581/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:00:17.925712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.022337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0efc10-294c-400c-b23e-e6378c71c43d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.055299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.055913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.056195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.056469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] PATH_INFO: `/v3/users/81be6b9ff52248769c68da4193af2a72` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.057606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] RBAC: Authorizing `identity:get_user(user_id=81be6b9ff52248769c68da4193af2a72)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.059035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.060574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 570/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:17 2022] GET /identity/v3/users/81be6b9ff52248769c68da4193af2a72 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:18.066424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.154381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.166965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78a4f-f96f-492c-b6f0-baa94fd8924d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.199010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.199635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.199915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.200184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] PATH_INFO: `/v3/projects/4991a2feac0d4261b33d2989fea45372` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.201805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] RBAC: Authorizing `identity:get_project(project_id=4991a2feac0d4261b33d2989fea45372)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.203258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921744c-4d61-4817-9a5a-1873e5f54302 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.204854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 582/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/projects/4991a2feac0d4261b33d2989fea45372 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:18.210826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.236746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.309322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250853c8-8b90-4cb7-8904-484048593734 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.342984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.343624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.343901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.344172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] PATH_INFO: `/v3/projects/4991a2feac0d4261b33d2989fea45372/users/81be6b9ff52248769c68da4193af2a72/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.346047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=4991a2feac0d4261b33d2989fea45372, user_id=81be6b9ff52248769c68da4193af2a72, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.347452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0305d-8870-4b51-b3cd-447cd2625cfd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.360263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 571/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 02:00:18 2022] PUT /identity/v3/projects/4991a2feac0d4261b33d2989fea45372/users/81be6b9ff52248769c68da4193af2a72/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:20.479086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcd657-ee81-49ad-99b7-cb0361cb295c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:20.479638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcd657-ee81-49ad-99b7-cb0361cb295c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:20.479638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcd657-ee81-49ad-99b7-cb0361cb295c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:20.480877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 583/1154] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:20.486303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:20.486715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:20.486858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:20.504938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:20.506143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:20.570118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 572/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:20.844879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcd657-ee81-49ad-99b7-cb0361cb295c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:20.944058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcd657-ee81-49ad-99b7-cb0361cb295c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:20.977461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:20.978101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:20.978381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:20.978650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:20.988531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:20.993281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:20.994356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:00:20.995342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 584/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:21.000778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.015236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.098755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413db0-4ae5-4e53-a429-1bc08a972b09 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.131197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.131791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.132069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.132339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.132987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:21.133287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.134676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:21.143163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 573/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:21.149087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.167673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.247594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c350de-ba06-49bd-9590-39fd2cf4f546 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.280658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.281276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.281584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.281862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] PATH_INFO: `/v3/users/81be6b9ff52248769c68da4193af2a72` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.282975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] RBAC: Authorizing `identity:get_user(user_id=81be6b9ff52248769c68da4193af2a72)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.284397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:21.285979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 585/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:21 2022] GET /identity/v3/users/81be6b9ff52248769c68da4193af2a72 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:21.291874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.364661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.390068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2907-df50-4e1e-9127-fb7711194c4a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.422023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.422616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.422898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.423173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.488248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.489719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:21.559230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.584870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 574/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:21.591057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.672820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.688879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe244-e3ce-46f4-9af1-11442ae2d200 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.721483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.722126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.722406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.722680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] PATH_INFO: `/v3/projects/4991a2feac0d4261b33d2989fea45372` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.723776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] RBAC: Authorizing `identity:get_project(project_id=4991a2feac0d4261b33d2989fea45372)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.725192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370003-94e9-4fa8-81b7-a7a11adb1d8e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:21.726815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 586/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:21 2022] GET /identity/v3/projects/4991a2feac0d4261b33d2989fea45372 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:21.733686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.828707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17269c8f-e02b-4664-90e5-974db4d7f59e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.862445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.863043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.863325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.863599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.864320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=4991a2feac0d4261b33d2989fea45372, user.id=81be6b9ff52248769c68da4193af2a72) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:21.864861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.866097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71630bd-9736-4c58-9876-1b297410080e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:21.871609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 575/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:21 2022] GET /identity/v3/role_assignments?user.id=81be6b9ff52248769c68da4193af2a72&scope.project.id=4991a2feac0d4261b33d2989fea45372&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:24.042368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cccc-f1ce-487a-a503-2aebd6612b01 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.042939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cccc-f1ce-487a-a503-2aebd6612b01 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.042939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cccc-f1ce-487a-a503-2aebd6612b01 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.044250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 587/1162] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:24.049717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.050112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.050274 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.068792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:24.070025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:24.099929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:24.135635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 576/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:24.400888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11cccc-f1ce-487a-a503-2aebd6612b01 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:24.500650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11cccc-f1ce-487a-a503-2aebd6612b01 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:24.533231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:24.533855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.534143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.534419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.554674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:24.600429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:24.601895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:24.697309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 588/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:24.703720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:24.804313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82856-178e-41e8-a81e-08f532e7d378 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:24.836730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:24.837347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.837657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.838186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.845177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:24.846669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3ceaaa43-1669-4f9c-9783-b27d552287ac None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:24.857723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:24.858923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:24.860120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 577/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 02:00:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:24.864787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:24.915231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:24.963968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a9004-db2b-4988-905c-4bcdf7ee6602 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:25.001734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:25.002335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:25.002614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:25.002888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:25.003522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:25.003825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:25.005177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfc18-ffa1-48bf-903b-c7faecc224c2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:25.012247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 589/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 29 02:00:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:27.154332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da51-4e83-4551-8246-dc5c1619aa20 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.154835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da51-4e83-4551-8246-dc5c1619aa20 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.155086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da51-4e83-4551-8246-dc5c1619aa20 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.156448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 578/1167] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:27.161597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9572b-9239-4422-a709-42a92277655c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.161994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9572b-9239-4422-a709-42a92277655c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.162154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9572b-9239-4422-a709-42a92277655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.180426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-edb9572b-9239-4422-a709-42a92277655c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:27.181638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-edb9572b-9239-4422-a709-42a92277655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:27.246242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 590/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:27.512914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da51-4e83-4551-8246-dc5c1619aa20 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:27.541191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:27.612684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da51-4e83-4551-8246-dc5c1619aa20 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:27.645335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:27.645954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.646240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.646515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.647185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:27.648544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cd605-f6e2-4b71-9da1-04e48a0dc33f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:27.664544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 579/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Sep 29 02:00:27 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:29.838320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435958fd-c26d-4382-bc0a-193c4e54a1f3 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:29.838885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435958fd-c26d-4382-bc0a-193c4e54a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:29.838885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435958fd-c26d-4382-bc0a-193c4e54a1f3 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:29.840181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 591/1170] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:29.846304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:29.846734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:29.846831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:29.865130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:29.866336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:29.929476 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 580/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:30.197322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435958fd-c26d-4382-bc0a-193c4e54a1f3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:30.244570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:30.296848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435958fd-c26d-4382-bc0a-193c4e54a1f3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:30.329079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:30.329717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.330004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.330277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] PATH_INFO: `/v3/domains/dc7fa5257a8f431aa9bbdebd05f8984f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.340458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dc7fa5257a8f431aa9bbdebd05f8984f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:30.342592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8036-00cf-4eba-ad86-597a0692b2b1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:30.344125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 592/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Sep 29 02:00:30 2022] GET /identity/v3/domains/dc7fa5257a8f431aa9bbdebd05f8984f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:30.350073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:30.368560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:30.445932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb85e78-160a-4d78-a9fe-a3f2e04f7f4e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:30.478722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:30.479315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.479592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.479860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.480502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:30.481981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8652627-245a-4b0e-8e77-df865057361d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:30.506974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 581/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 02:00:30 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:32.808346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81ef7-f7c7-402b-808e-ba81e87dda98 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:32.808885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81ef7-f7c7-402b-808e-ba81e87dda98 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:32.808885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c81ef7-f7c7-402b-808e-ba81e87dda98 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:32.810943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 593/1174] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:32.816085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8a19-5531-4880-b72b-513b80291906 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:32.816527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8a19-5531-4880-b72b-513b80291906 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:32.816647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8a19-5531-4880-b72b-513b80291906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:32.836054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-90df8a19-5531-4880-b72b-513b80291906 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:32.837240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90df8a19-5531-4880-b72b-513b80291906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:32.898648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:32.903933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 582/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:33.173305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c81ef7-f7c7-402b-808e-ba81e87dda98 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.274146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c81ef7-f7c7-402b-808e-ba81e87dda98 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.281693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:33.309729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.310588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.311043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.311322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] PATH_INFO: `/v3/domains/dc7fa5257a8f431aa9bbdebd05f8984f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.312437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dc7fa5257a8f431aa9bbdebd05f8984f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:33.313898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ccb7a-96d8-4b8f-921b-044d555f5875 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:33.315445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 594/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/domains/dc7fa5257a8f431aa9bbdebd05f8984f => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:33.321200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df8a19-5531-4880-b72b-513b80291906 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.416353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df8a19-5531-4880-b72b-513b80291906 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.449140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.449752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.450029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.450299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.451255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:33.452762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87b191-437c-451f-80e8-29962cb549b2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:33.472993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 583/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 02:00:33 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:00:35.664675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8fbd-509c-4154-ac7e-a74b6533c38c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:35.665197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8fbd-509c-4154-ac7e-a74b6533c38c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:35.665317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8fbd-509c-4154-ac7e-a74b6533c38c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:35.666609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 595/1178] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:35.672516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:35.672930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:35.673070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:35.690991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:35.692165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:35.741004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:35.757529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 584/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:36.027687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8fbd-509c-4154-ac7e-a74b6533c38c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.128931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8fbd-509c-4154-ac7e-a74b6533c38c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.160759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.161372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.161679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.161952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.172179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:36.176900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:36.177862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:00:36.178826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 596/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:36.184211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.279413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6ea2f-1848-4fff-b1e8-6acdea505895 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.312636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.313232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.313536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.313801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.314444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:36.314742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:36.316099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:36.323726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 585/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:36.329592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.364827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:36.429516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4300f-d6ef-4712-8447-df58c132d504 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.462290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.463176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.463456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.463729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] PATH_INFO: `/v3/users/1bb7243a23a1478587184ebafcd2071b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.476958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7243a23a1478587184ebafcd2071b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:36.478434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:36.480034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 597/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/users/1bb7243a23a1478587184ebafcd2071b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:36.486620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.534558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:36.584402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526626-01e9-4731-9e89-ce6d16be778f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.617470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.618098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.618378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.618650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.682923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:36.684371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:36.729894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:36.780947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 586/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:36.786882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.875883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:36.884745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f95f-6bda-4d2c-995f-ba02afd35361 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.917551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.918180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.918461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.918735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] PATH_INFO: `/v3/projects/10b25602192e4e989d610e59666f97c4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.920353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] RBAC: Authorizing `identity:get_project(project_id=10b25602192e4e989d610e59666f97c4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:36.921809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb1ab-6e00-41c0-9671-a65944ad8b03 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:36.923634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 598/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/projects/10b25602192e4e989d610e59666f97c4 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:36.929565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:37.024402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ca263-161b-432a-b491-af4218c418d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:37.057814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:37.058350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:37.058629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:37.058899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:37.059614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=10b25602192e4e989d610e59666f97c4, user.id=1bb7243a23a1478587184ebafcd2071b) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:37.060170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:37.061596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcbfbc-d74a-4545-8c4d-9f64d35055e1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:37.066785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 587/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/role_assignments?user.id=1bb7243a23a1478587184ebafcd2071b&scope.project.id=10b25602192e4e989d610e59666f97c4&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:39.183835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b84e-bc4c-4759-afbb-c89d68eba0ea None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.184331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b84e-bc4c-4759-afbb-c89d68eba0ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.184437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b84e-bc4c-4759-afbb-c89d68eba0ea None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.186355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 599/1186] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:39.191448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.191846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.192005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.210222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:39.211408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:39.219275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:39.276673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 588/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:39.545988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b84e-bc4c-4759-afbb-c89d68eba0ea None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:39.646254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b84e-bc4c-4759-afbb-c89d68eba0ea None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:39.678952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:39.679566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.679842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.680114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.690778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:39.695533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:39.696636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:00:39.697541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 600/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:39.702772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:39.797577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bd105-f32e-4128-8fce-fb3d908a5766 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:39.829666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:39.830255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.830531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.830799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.831529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:39.831834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:39.833186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:39.841083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 589/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:39.846846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:39.868725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:39.945437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d200a-e7d2-42a2-9313-76e01039e8da None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:39.978582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:39.979199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.979481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.979754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] PATH_INFO: `/v3/users/1bb7243a23a1478587184ebafcd2071b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.980861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7243a23a1478587184ebafcd2071b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:39.982966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:39.984520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 601/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:39 2022] GET /identity/v3/users/1bb7243a23a1478587184ebafcd2071b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:39.990284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:39.993965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.086190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce112-6e8f-4646-a00b-04bbd7fefe6c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.119446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.120075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.120355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.120629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] PATH_INFO: `/v3/projects/10b25602192e4e989d610e59666f97c4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.121763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] RBAC: Authorizing `identity:get_project(project_id=10b25602192e4e989d610e59666f97c4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.123377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac41e8-a388-43b0-9ca4-b546fd4737a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:40.124973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 590/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:39 2022] GET /identity/v3/projects/10b25602192e4e989d610e59666f97c4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:40.130889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.217807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.229551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc098a-e070-475f-9746-72a4b5d65120 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.262217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.262906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.263385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.263781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] PATH_INFO: `/v3/projects/10b25602192e4e989d610e59666f97c4/users/1bb7243a23a1478587184ebafcd2071b/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.265678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] RBAC: Authorizing `identity:create_grant(project_id=10b25602192e4e989d610e59666f97c4, user_id=1bb7243a23a1478587184ebafcd2071b, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.267094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f513b9-902e-45f3-ab39-57bfce921527 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:40.279629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 602/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 02:00:40 2022] PUT /identity/v3/projects/10b25602192e4e989d610e59666f97c4/users/1bb7243a23a1478587184ebafcd2071b/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:42.408129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1edf-8225-419a-9a01-11199934e661 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:42.408634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1edf-8225-419a-9a01-11199934e661 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:42.408634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb1edf-8225-419a-9a01-11199934e661 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:42.409970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 591/1193] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:42.415401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:42.415770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:42.415958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:42.434434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:42.435756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:42.499602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 603/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:42.769918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1edf-8225-419a-9a01-11199934e661 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:42.839405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:42.869193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb1edf-8225-419a-9a01-11199934e661 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:42.901947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:42.902561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:42.902845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:42.903120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:42.913023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:42.918243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:42.919979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:00:42.920851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 592/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:42.926089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:43.001563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:43.023863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2c635-1258-4ee3-aea2-90feb8d0cfc2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:43.057260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:43.057911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:43.058194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:43.058468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:43.059121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:43.059425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:43.060793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:43.068724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 604/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:43.074685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:43.176208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8042b5-bd72-4dc1-b040-ae26e1b4172e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:43.204236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:43.209669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:43.210294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:43.210576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:43.210850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] PATH_INFO: `/v3/users/1bb7243a23a1478587184ebafcd2071b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:43.211962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7243a23a1478587184ebafcd2071b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:43.213693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:43.215256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 593/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:43 2022] GET /identity/v3/users/1bb7243a23a1478587184ebafcd2071b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:43.221608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:43.318469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1c62d-aadd-4783-acfb-83c777694064 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:43.350668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:43.351257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:43.351535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:43.351807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:43.362263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:43.419063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:43.420538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:43.515238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 605/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:43.521308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:43.617062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065241-fecd-416d-a740-6642c8bdaa49 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:43.649696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:43.650313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:43.650596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:43.650869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] PATH_INFO: `/v3/projects/10b25602192e4e989d610e59666f97c4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:43.651982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] RBAC: Authorizing `identity:get_project(project_id=10b25602192e4e989d610e59666f97c4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:43.654036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b982e5-f214-4eb0-aab0-9b59bf291b6c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:43.655618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 594/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:43 2022] GET /identity/v3/projects/10b25602192e4e989d610e59666f97c4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:43.661645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:43.702076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:43.758999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ccfdb-b6f1-4cdc-8667-980df9fa9e77 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:43.791730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:43.792323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:43.792602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:43.792873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:43.793616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=10b25602192e4e989d610e59666f97c4, user.id=1bb7243a23a1478587184ebafcd2071b) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:43.793965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:43.795568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311556-4df2-49c7-8316-a041ee6bca45 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:43.801080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 606/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:43 2022] GET /identity/v3/role_assignments?user.id=1bb7243a23a1478587184ebafcd2071b&scope.project.id=10b25602192e4e989d610e59666f97c4&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:53.645684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=66 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:53.798983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=48 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:39.614489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3c70-9418-4fed-aece-baa943900d7d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:39.614489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3c70-9418-4fed-aece-baa943900d7d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:39.614489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3c70-9418-4fed-aece-baa943900d7d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:39.616675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 595/1201] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:01:39.622939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:39.623455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:39.623546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:39.645210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:39.646529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:39.743442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 607/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:40.057851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3c70-9418-4fed-aece-baa943900d7d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:40.198717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3c70-9418-4fed-aece-baa943900d7d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:40.245192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:40.246053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:40.246445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:40.246744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:40.263195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:40.264752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:40.284572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:40.286054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:40.293761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:40.293761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:40.293761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:40.293761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 596/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:40.296050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:40.440273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e576f-228b-4c2d-bf49-d6b0ebcec2f2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:40.478295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:40.485475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:40.486127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:40.486424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:40.486740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:40.488050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:40.488378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:40.489785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a6bef-ac20-47b2-ad92-d068c6aded37 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:40.505985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 608/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:40.511565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:40.599214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:40.656813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097323-4455-4d14-b62c-e3097ee6f7ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:40.707517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:40.708387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:40.708667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:40.708960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:40.709646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:40.711325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b508e-4eca-43f9-8c24-06f8782319d5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:40.739489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 597/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 29 02:01:40 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:01:43.146486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdca13-3f19-41d1-a119-a1c996d9fee2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.147059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdca13-3f19-41d1-a119-a1c996d9fee2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.147059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdca13-3f19-41d1-a119-a1c996d9fee2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.148518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 609/1206] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:43.155811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.156305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.156459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.177098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:43.178365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:43.252368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 598/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:43.541617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdca13-3f19-41d1-a119-a1c996d9fee2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:43.654649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdca13-3f19-41d1-a119-a1c996d9fee2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:43.693091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:43.693845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.694018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.694332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.705540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:43.710461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:43.711461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:43.712601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 610/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:43.718915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:43.763690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:43.841810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb29a0-36c0-4366-8826-97c524e81863 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:43.880133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:43.880746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.881024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.881293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.882003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:43.883272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:43.883648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:43.893041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 599/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:43.898975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:43.953314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:44.007805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13c9f-b930-4e8d-b105-944622b97f4a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:44.046191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:44.046826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:44.047105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:44.047374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:44.058986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:44.060451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:44.076866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:44.077955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:44.078871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:44.078871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:44.078871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:44.078871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 611/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:44.083920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:44.203443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:44.206176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36a890-64e1-42e8-a233-37f98a2cf404 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:44.251394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:44.252041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:44.252324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:44.252599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:44.253246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:44.253584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:44.254965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:44.269550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 600/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:44.273959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:44.400136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719813d-d2b7-45b9-8cec-539f099a4a96 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:44.402905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:44.441294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:44.441997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:44.442236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:44.442561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:44.450672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:44.452204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:44.465456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:44.466508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:44.468157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 612/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:44.472589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:44.578875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4c95f-433f-46b2-ac6a-de228cf6ddb9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:44.615483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:44.616103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:44.616383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:44.616654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:44.617384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:44.617720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:44.619233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:44.641091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 601/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:44.642449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:44.757233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4c9d-e07c-48e4-bec0-5531efa93ab8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:44.796540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:44.797159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:44.797439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:44.797756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:44.829790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:44.874866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:44.876390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:44.991026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 613/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:01:44.997808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:45.017588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:45.116647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025425c4-7be4-4ae5-bf3e-52305f581580 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:45.157730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:45.158367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.158651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.158924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.171120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:45.173559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:45.192152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:45.193179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:45.194252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:45.194252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:45.194252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:45.196046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 602/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:45.202727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:45.273563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:45.319224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703470d-97fb-47b3-950a-b77ef0d87531 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:45.358736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:45.359352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.359637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.359912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.360557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:45.360858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:45.362378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:45.386400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 614/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:45.392121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:45.476596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:45.518803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b3a4-9ab0-408e-bf5b-2518fa99b821 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:45.566779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:45.567417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.567721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.568073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.577007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:45.578603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:45.592923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:45.594092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:45.595192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 603/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:45.600393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:45.710900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a4b3-bd74-4aed-acef-0052c82f7c93 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:45.737052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:45.754423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:45.755219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.755615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.755997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.757034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:45.757346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:45.759197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca462e-9a9d-48bd-a827-99e893fc8619 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:45.786424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 615/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:45.786694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:45.902094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048928ab-0415-4c62-bb4c-2980467f541a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:45.934987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:45.941812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:45.942401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.942704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.943071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.943877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=8f41d973ed984648b99e75f4678575d2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:45.944270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:45.945916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198788-fbe4-43a9-bfb9-5acd512ae002 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:45.952406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 604/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:01:45 2022] GET /identity/v3/role_assignments?user.id=8f41d973ed984648b99e75f4678575d2&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:48.181073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c3c3-9bbe-48dd-b0a1-cc838701f95b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:48.181801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c3c3-9bbe-48dd-b0a1-cc838701f95b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:48.181801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c3c3-9bbe-48dd-b0a1-cc838701f95b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:48.183147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 616/1220] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:48.188508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:48.188940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:48.189066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:48.208502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:48.209803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:48.282770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 605/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:48.584633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c3c3-9bbe-48dd-b0a1-cc838701f95b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:48.698064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c3c3-9bbe-48dd-b0a1-cc838701f95b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:48.738018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:48.738693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:48.739013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:48.739304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:48.752210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:48.757049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:48.758395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:48.759827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 617/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:48.769250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:48.883544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d24bb-6bd4-4acf-ac9e-85b5b90d66f0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:48.907505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:48.920973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:48.921623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:48.921908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:48.922182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:48.922850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:48.923156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:48.924528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:48.934495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 606/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:48.940838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:48.991872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:49.055910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262e56-5984-4598-bba1-1db98029578a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.099938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:49.100609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:49.100936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:49.101236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:49.112953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:49.114492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:49.131194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:49.132332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:49.133237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:49.133237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:49.133237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:49.133237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 618/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:49.139039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:49.247240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0251-d0d4-4026-b787-72eea95776b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.284335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:49.284955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:49.285268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:49.285585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:49.286243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:49.286618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:49.288217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:49.306832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 607/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:49.308087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:49.412450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:49.421015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5430-b042-44a4-95d8-df59969bb518 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.457561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:49.458190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:49.458472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:49.458748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:49.467155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:49.468586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:49.481925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:49.483449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:49.485320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 619/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:49.490098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:49.540663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:49.595675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82709083-03ef-4389-ac3f-45db27d69fa7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.636417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:49.637039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:49.637325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:49.637643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:49.638376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:49.638688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:49.640347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:49.658424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 608/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:49.664918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:49.778242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cfcb8-2c7c-4ceb-bc67-fcf26bd49b00 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.812987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:49.813802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:49.814182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:49.814557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:49.826567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:49.828014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:49.844485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:49.845780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:49.846917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:49.846917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:49.846917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:49.849668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 620/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:49.852165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:49.959630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83834258-34da-445c-a18d-5a29077991f3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:49.961858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:50.000090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:50.000707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.000995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.001254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.002016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:50.002354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:50.003817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:50.015439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 609/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:50.021285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:50.033176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:50.141974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d994d-2753-4c03-94ef-3dd9d658aee7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:50.180671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:50.181471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.181837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.182108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.189088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:50.190640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:50.202549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:50.203521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:50.204439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 621/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:50.209543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:50.324006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef21f3-9462-4a61-a859-488ad3aa00d1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:50.360246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:50.360851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.361130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.361412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.362112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:50.362458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:50.363855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1941f-3d63-4c2d-afb2-5f8ac971a183 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:50.376515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 610/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:50.382718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:50.467092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:50.506534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8adca-f0f6-4437-9b12-b7d401ea1f51 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:50.547986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:50.548659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.548941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.549216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/8f41d973ed984648b99e75f4678575d2/roles/982cd18b0c444ab382312e2cfd8a13f9` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.565225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=8f41d973ed984648b99e75f4678575d2, role_id=982cd18b0c444ab382312e2cfd8a13f9)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:50.566712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915f717-57b0-415b-bc4b-e9e8b2d9b8a2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:50.581576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 622/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 02:01:50 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/8f41d973ed984648b99e75f4678575d2/roles/982cd18b0c444ab382312e2cfd8a13f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:01:52.863996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaaa1-c100-4ba6-a0bb-14f6080616cc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.864810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaaa1-c100-4ba6-a0bb-14f6080616cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.864810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaaa1-c100-4ba6-a0bb-14f6080616cc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.866069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 611/1233] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:01:52.873726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.874238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.874348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.893667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:52.894871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:52.965118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 623/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:53.256939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaaa1-c100-4ba6-a0bb-14f6080616cc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.285463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:53.376805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaaa1-c100-4ba6-a0bb-14f6080616cc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.416182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.416831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.417116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.417394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.428434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:53.435216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:53.436496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:53.437622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 612/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:53.442662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.495312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:53.555182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc3af-9341-4335-8d3b-93b22a26af55 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.594452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.595092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.595389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.595694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.596469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:53.596821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:53.598332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:53.607432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 624/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:53.613523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.710489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:53.730805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b5f2-779f-42a6-91a9-74d39fc2b335 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.770435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.771087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.771363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.771651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.783820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:53.785698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:53.802947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:53.804229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:53.805160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:53.805160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:53.805160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:53.805160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 613/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:53.810901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.918077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905566-217f-4b12-9200-7626eb4be838 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.927886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:53.958605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.959313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.959602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.959881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.960519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:53.960828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:53.962598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:53.976364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 625/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:53.982705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:54.090185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9cabb-df1e-48a7-9fed-f1d352d2e8c2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:54.127279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:54.127848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:54.128159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:54.128416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:54.131197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:54.137975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:54.139980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:54.153990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:54.155095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:54.156150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 614/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:54.162491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:54.279398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed2c8-3109-4b68-9c74-586e5d4eaff2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:54.318345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:54.318962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:54.319243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:54.319519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:54.320245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:54.320555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:54.322705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:54.342748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 626/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:54.348819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:54.459082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea77cd-8471-4701-a07b-9a9a8fca839a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:54.496774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:54.497373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:54.497697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:54.497944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:54.561988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:54.568977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:54.570462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:54.676612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 615/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:01:54.683768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:54.711142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:54.797232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5fb0-f7d9-41d5-aea7-17f97b538bbe None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:54.835222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:54.835857 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:54.836162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:54.836516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:54.849672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:54.851217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:54.868285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:54.870064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:54.871002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:54.871002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:54.871002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:54.871002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 627/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:54.876913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:54.986004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:54.994258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f44ec-57e5-41c3-96ac-d29d2fbcc266 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:55.034517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:55.035145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.035409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.035677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.036322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:55.036620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:55.038029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:55.055670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 616/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:55.056956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:55.146648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:55.171179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d726-4f55-42db-bb4f-4848c8028dcd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:55.207612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:55.208500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.208785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.209048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.216692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:55.218174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:55.230022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:55.230997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:01:55.231907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 628/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:55.237194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:55.343606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8de6db-d4e4-49cf-9fdb-f4f63850c01c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:55.383376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:55.385079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.385351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.385739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.386532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:55.386901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:55.388553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b32e3d-2cee-4e4f-bffb-b5252ca7b45d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:55.403662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 617/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:55.409841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:55.524226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebb75f-5e88-4623-a45e-9bf09edd99d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:55.560720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:55.561369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.561807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.562118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.563015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] RBAC: Adding query filter params (role.id=982cd18b0c444ab382312e2cfd8a13f9, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=8f41d973ed984648b99e75f4678575d2) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:55.563355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:55.565120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d5898-159f-4187-a91b-e8d66e76dca0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:55.572091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 629/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:01:55 2022] GET /identity/v3/role_assignments?user.id=8f41d973ed984648b99e75f4678575d2&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=982cd18b0c444ab382312e2cfd8a13f9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:58.196276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32961-fc35-418f-93da-b3cb3ca727ea None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.197393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32961-fc35-418f-93da-b3cb3ca727ea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.197500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32961-fc35-418f-93da-b3cb3ca727ea None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.198884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 618/1247] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:58.205074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.205582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.205755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.212815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:58.226214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:58.227434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:58.302025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 630/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:58.598213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32961-fc35-418f-93da-b3cb3ca727ea None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:58.618287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:58.706539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32961-fc35-418f-93da-b3cb3ca727ea None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:58.747562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:58.748228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.748599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.748940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.761841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:58.766800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:58.768412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:58.769526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 619/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:58.777795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:58.891784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d2d12-a9df-4e00-9e78-53beeaeaf5b9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:58.922792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:58.928764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:58.929439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.929764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.930023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.930818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:58.931854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:58.933537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:58.943046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 631/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:58.949711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:59.034201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:59.059440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89971-bc26-449e-84e4-878347bae872 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:59.101390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:59.102057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:59.102338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:59.102607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:59.113408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:59.114881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:59.130283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:59.131370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:59.132753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:59.132753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:59.132753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:59.132753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 620/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:59.137962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:59.245905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5cb5a-876a-48de-a2fd-c0652901d00a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:59.283028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:59.283665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:59.283992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:59.284270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:59.284910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:59.285271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:59.286779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:59.299337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 632/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:59.305414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:59.418078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddd23-012c-4e6e-ba50-46907e1f9656 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:59.448067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:59.456894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:59.457568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:59.457845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:59.458118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:59.471100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:59.472589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:59.486173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:59.487282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:01:59.488278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 621/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:59.494219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:59.553299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:59.601755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4bb3-5b8a-4356-8efb-f994f470983d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:59.637360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:59.638013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:59.638292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:59.638562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:59.639300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:59.639605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:59.641053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:59.660565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 633/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:59.667145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:59.781818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836a6d2-2af8-43e1-9743-4a7b6e4353a8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:59.823155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:59.823688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:59.823972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:59.824251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:59.882140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:59.894688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:59.896153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.000588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 622/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 02:02:00.001703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.112919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d3f-58da-4491-9ca0-90976967a8f6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.127051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:00.149225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.150762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.151042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.151315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.160991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.162437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:00.177117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:00.178264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:00.179585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:00.179585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:00.179585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:00.179585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 634/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:00.185025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.269108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:00.281896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423c62-fe7a-40c9-aa85-fc0846ac437e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.314979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.315575 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.315847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.316117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.316746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:00.317043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.318435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.329252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 623/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:00.334841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.432555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db4289-2628-4548-b046-41d94fc894f8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.465110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.465755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.466040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.466313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.472757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.474235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:02:00.485778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:00.486808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:00.487750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 635/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:00.492568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.588492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d556-2d0c-4116-b375-9ec1eea4782f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.620745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.621335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.621642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.621916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.622598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:00.622903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.624322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039b6c-22f7-49a1-b71c-9e89a96fc390 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.636234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 624/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:00.643856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.674312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:00.749254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8259-7bd4-4d27-8353-487041420d41 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.788185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.788793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.789075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.789348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.790095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=8f41d973ed984648b99e75f4678575d2) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:00.790457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.791877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0807fb-95e7-4ce6-b3fa-6556218e23cf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:00.797117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 636/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/role_assignments?user.id=8f41d973ed984648b99e75f4678575d2&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:02.927423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff06b-d9d1-4ce4-aaa3-cfb33f7153cf None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:02.928003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff06b-d9d1-4ce4-aaa3-cfb33f7153cf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:02.928003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff06b-d9d1-4ce4-aaa3-cfb33f7153cf None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:02.929281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 625/1261] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:02.934550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:02.934988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:02.935093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:02.953882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:02.955049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:03.019649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 637/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:03.288096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff06b-d9d1-4ce4-aaa3-cfb33f7153cf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:03.299576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:03.387604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff06b-d9d1-4ce4-aaa3-cfb33f7153cf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:03.421016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:03.421658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:03.421938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:03.422208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:03.432091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:02:03.436800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:03.437901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:03.439096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 626/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:03.443829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:03.461563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:03.541223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec3e7f-f973-4da9-907c-2a0826df739c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:03.573584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:03.574173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:03.574451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:03.574720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:03.575367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:03.575668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:03.577028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:03.584925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 638/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:03.591661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:03.658109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:03.690483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13150c5e-a68c-4a60-ab90-05ef688a1565 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:03.724282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:03.724901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:03.725185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:03.725461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:03.735250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:03.736772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:03.752721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:03.753952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:03.755340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:03.755340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:03.755340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:03.755340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 627/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:03.761172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:03.848071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:03.866711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f1b81-3b7a-4711-95fa-91f35dfa66da None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:03.899462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:03.900765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:03.901052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:03.901330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:03.902007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:03.902316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:03.903680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:03.914986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 639/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:02:03.920907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.018000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c447bd-7aaa-49de-bf7e-f31e69a56a98 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.037059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:04.051321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.051937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.052219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.052494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.059741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.061169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:02:04.072135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:04.073255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:04.074637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 628/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:04.078982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.176949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f119047-37b2-4534-a02e-79daa87cb93d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.209437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.210072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.210354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.210628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.211346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:04.211652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.213879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.222317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:04.231549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 640/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:04.237326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.332761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98ab68-78e1-4ba6-a0ad-ffe7506db0f3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.365834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.366388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.366676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.366953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.377072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.378544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:04.392728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:04.393731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:04.394727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:04.394727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:04.394727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:04.394727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 629/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:04.399995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.495692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc108-74b4-4429-9163-d683bcc0b0a5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.528665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.529247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.529544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.529817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.530456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:04.530737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.532073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.542921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 641/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:04.548537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.579547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:04.646454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2a87-2cfa-41af-b2a2-34c8405f5f08 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.678680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.679295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.679577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.679855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.686326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.687754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:02:04.699301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:04.700358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:04.701645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 630/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:04.706135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.769666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:04.811600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61481-38f9-4159-be06-eec901586ff4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.844153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.844751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.845030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.845302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.846014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:04.846319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:04.847737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9bd7c-bdfc-4bd8-9ca1-4acbffc2dfc9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:04.859281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 642/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:04.865446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:04.955793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:04.965237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a180-1dba-404d-b98c-9e8b9877d638 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:04.997500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:04.998168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.998451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.998724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] PATH_INFO: `/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/8f41d973ed984648b99e75f4678575d2/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.000580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d127ed98784cebb58caf88b1125f26, user_id=8f41d973ed984648b99e75f4678575d2, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.002073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60430a-6678-4cda-8dc9-df065161ccda None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.014429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 631/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 29 02:02:04 2022] PUT /identity/v3/projects/f2d127ed98784cebb58caf88b1125f26/users/8f41d973ed984648b99e75f4678575d2/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:02:07.131173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda5f6-c096-4c4e-8c15-ed7a059dd650 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:07.131670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda5f6-c096-4c4e-8c15-ed7a059dd650 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:07.131778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda5f6-c096-4c4e-8c15-ed7a059dd650 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:07.133059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 643/1274] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:07.139128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:07.139545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:07.139679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:07.157763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:07.158936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:07.223511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 632/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:07.494874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accda5f6-c096-4c4e-8c15-ed7a059dd650 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:07.592976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accda5f6-c096-4c4e-8c15-ed7a059dd650 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:07.611222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:07.628388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:07.629012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:07.629294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:07.629596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:07.639532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:02:07.644286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:07.645361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:07.646355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 644/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 29 02:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:07.651525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:07.729776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:07.750770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5358cea-3ef2-4afa-9871-ea5718d47995 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:07.791410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:07.792049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:07.792568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:07.792734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:07.793601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:07.793814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:07.795319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:07.804832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 633/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 29 02:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:07.811264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:07.908000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd1c4-4d4a-413c-b3d4-21fff0f8c5c0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:07.942935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:07.943554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:07.943835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:07.944109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:07.954227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:07.955662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:07.970206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:07.971349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:07.972473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:07.972473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:07.972473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:07.972473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 645/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:07.977121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:08.073338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832b6c-f6f1-4c15-8b9b-beaee9e8e89e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:08.106904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:08.107506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:08.107784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:08.108054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:08.108687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:08.108984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:08.110365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:08.121974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 634/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:08.127704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:08.158619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:08.227966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b964f-fce0-415a-87ff-ba1d0c872a3f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:08.260912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:08.261543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:08.261825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:08.262093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:08.269117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:08.270592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:02:08.281722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:08.285674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:08.286896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 646/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:08.288660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:08.293164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:08.387512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175dad-be6f-4844-b4db-b164b3886ebb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:08.422067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:08.422661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:08.422938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:08.423205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:08.423914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:08.424215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:08.425645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:08.442721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 635/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 29 02:02:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:08.448717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:08.536933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:08.547483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa5bdd-d1fe-4ac5-8bc9-0403cabd2132 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:08.579179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:08.579768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:08.580046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:08.580316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:08.643601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:08.644964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:08.729591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:08.739850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 647/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 29 02:02:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:02:08.745812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:08.805223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:08.842069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca1d5-63f6-4577-a3a5-2b8559bc84b0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:08.874634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:08.875252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:08.875531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:08.875803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:08.885929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:08.887364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:08.901975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:08.903102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:08.904435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:08.904435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:08.904435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:08.904435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 636/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:08.908595 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.003421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318334af-ce1b-41c1-bae5-507d6885720c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.036345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.036934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.037228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.037478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.038126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:09.038423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.039774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.050452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 648/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:09.056009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.157262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0638a9-5da0-4601-ac64-9cd062806942 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.170194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:09.189672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.190293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.190573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.190844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.197882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.199317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:02:09.210206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:09.211324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 29 02:02:09.213283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 637/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:09.217912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.266159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:09.313630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70f65-6519-4d19-b1bb-c68cedcc01e3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.345726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.346314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.346593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.346861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.347533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:09.347836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.349239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc032-45f0-4511-b82e-05d693fc7c47 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.360666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 649/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:09.366711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.464252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8cec-c7af-4be2-bd1e-491f96f61b62 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.496299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.496884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.497160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.497430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.498164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] RBAC: Adding query filter params (role.id=91c74d335ba54b558054c228da1b6365, scope.project.id=f2d127ed98784cebb58caf88b1125f26, user.id=8f41d973ed984648b99e75f4678575d2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:09.498472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.499999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05422ce1-0fd7-489f-8a56-fac3b8ff6276 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.505632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 638/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/role_assignments?user.id=8f41d973ed984648b99e75f4678575d2&scope.project.id=f2d127ed98784cebb58caf88b1125f26&role.id=91c74d335ba54b558054c228da1b6365 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:11.648294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3225fe-2089-4ad6-8746-4521f89a3099 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:11.648834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3225fe-2089-4ad6-8746-4521f89a3099 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:11.648834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3225fe-2089-4ad6-8746-4521f89a3099 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:11.650927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 650/1288] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:11.656244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:11.656686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:11.656781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:11.675218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:11.676392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:11.704399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:11.743020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 639/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:12.029304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3225fe-2089-4ad6-8746-4521f89a3099 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:12.131846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3225fe-2089-4ad6-8746-4521f89a3099 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:12.142354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:12.165594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:12.166220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:12.166502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:12.166776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:12.167354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:12.168717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:12.177282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:12.178492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:12.179384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 651/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:12.186355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:12.282099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab985fa-cd15-43a6-868b-44ea6a004f0d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:12.315021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:12.315619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:12.315925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:12.316197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:12.316818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:12.317118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:12.318521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf96ebf-dafe-4897-aa02-feee175af56a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:12.323299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 640/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:12.329080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:12.425866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42fab-ca94-4344-8352-a7999848bb80 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:12.457620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:12.458209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:12.458485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:12.458755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:12.459364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:12.459663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:12.461010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7618d9-840e-4c85-b84b-281b2c6f8a2d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:12.466134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 652/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:14.589871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6543-da24-40c8-84f8-1351d2be2641 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:14.590409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6543-da24-40c8-84f8-1351d2be2641 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:14.590409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6543-da24-40c8-84f8-1351d2be2641 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:14.591649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 641/1293] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:14.596791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e044-2f37-402a-90ca-193832497cb3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:14.597167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e044-2f37-402a-90ca-193832497cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:14.597352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e044-2f37-402a-90ca-193832497cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:14.615705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cdb9e044-2f37-402a-90ca-193832497cb3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:14.616889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cdb9e044-2f37-402a-90ca-193832497cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:14.645170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:14.681937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 653/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:14.949948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6543-da24-40c8-84f8-1351d2be2641 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:14.981175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:15.049897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6543-da24-40c8-84f8-1351d2be2641 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:15.081941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:15.082531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:15.082808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:15.083077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:15.083719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:15.085070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1db02-34b6-44a1-9e21-34c29c521330 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:15.100139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 642/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 29 02:02:14 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:02:17.237833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322e4c-5bfb-4081-877d-bbc44c97caf0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.238365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322e4c-5bfb-4081-877d-bbc44c97caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.238365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322e4c-5bfb-4081-877d-bbc44c97caf0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.239697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 654/1296] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:17.244878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.245324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.245419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.263879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:17.265062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:17.335199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 643/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:17.600272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322e4c-5bfb-4081-877d-bbc44c97caf0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:17.699780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322e4c-5bfb-4081-877d-bbc44c97caf0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:17.733143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:17.733790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.734069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.734338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.734906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:17.736255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:17.745392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:17.746606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:17.747730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 655/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:17.752566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:17.773349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:17.858522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c7e3-1684-41c8-bba9-51ebe6365210 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:17.890969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:17.891571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.891852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.892126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.892745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:17.893046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:17.894440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:17.899307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 644/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:17.905280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:17.937100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:18.003647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216ecf-ea21-44c3-a103-9a29c59b8030 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:18.035385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:18.035975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:18.036253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:18.036521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:18.037202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] RBAC: Adding query filter params (interface=public, service_id=cc40740d41cb45e599eab90d08e1f02c, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:18.037533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:18.038883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c2a58-6b0e-48d0-b209-73decf853e41 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:18.044504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 656/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 29 02:02:17 2022] GET /identity/v3/endpoints?service_id=cc40740d41cb45e599eab90d08e1f02c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:18.050149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:18.133750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:18.151875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a183e7-af5a-40d5-90f4-147994975b9c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:18.185674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:18.186280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:18.186562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:18.186840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:18.187441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:18.188806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac649-da72-4626-9ca6-f25ba97f0995 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:18.195313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 645/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 29 02:02:18 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:02:20.332920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b902-3bb7-49bb-8652-879dd3e695da None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:20.333447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b902-3bb7-49bb-8652-879dd3e695da None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:20.333563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b902-3bb7-49bb-8652-879dd3e695da None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:20.334843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 657/1302] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:20.340389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:20.340841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:20.340974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:20.359219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:20.360330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:20.424507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 646/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:02:20.689937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b902-3bb7-49bb-8652-879dd3e695da None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:20.788592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:20.796373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b902-3bb7-49bb-8652-879dd3e695da None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:20.828223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:20.828841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:20.829119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:20.829389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:20.829989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:20.831347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:20.840783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:20.842010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Sep 29 02:02:20.843096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 658/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:20.847890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:20.921583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:20.944231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57189-1db9-4fb1-ba10-4ba5a124c3e9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:20.978244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:20.978834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:20.979110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:20.979386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:20.980001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:20.980300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:20.981686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5801f-d970-4203-8109-bc35ee2b0421 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:20.986572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 647/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:20.992314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:21.090331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c505d1-178a-4e79-bd07-c43e0df0c241 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:21.123663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:21.124270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:21.124550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:21.124828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:21.125492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:21.126893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7d312-e667-4cca-86d0-e3957d741855 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:21.146046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 659/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:02:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:02:30.983811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=30 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:31.142285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:24.975815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339fc6-b27a-4863-85c8-d50a33f906cd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:24.976306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339fc6-b27a-4863-85c8-d50a33f906cd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:24.976400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84339fc6-b27a-4863-85c8-d50a33f906cd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:24.983206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9208-ec60-45e4-b117-5c30b28cebb4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:24.983627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9208-ec60-45e4-b117-5c30b28cebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:24.983757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a9208-ec60-45e4-b117-5c30b28cebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:24.985577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 648/1307] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:25.065917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-395a9208-ec60-45e4-b117-5c30b28cebb4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:25.067057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-395a9208-ec60-45e4-b117-5c30b28cebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:25.197537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 660/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:25.491930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:25.492384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:25.492766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:25.494410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 649/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu Sep 29 02:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:25.500438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32457736-ed5b-471b-bd0d-820b745d611b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:25.500756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32457736-ed5b-471b-bd0d-820b745d611b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:25.501045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32457736-ed5b-471b-bd0d-820b745d611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:25.580267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-32457736-ed5b-471b-bd0d-820b745d611b None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:25.581467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-32457736-ed5b-471b-bd0d-820b745d611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:25.603955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:25.669317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 661/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Sep 29 02:03:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:25.679287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:25.681170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:25.802786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13159-a9cf-4b5b-b73d-500a13e82a30 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:25.889158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:25.889806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:25.890082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:25.890348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:25.891983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:25.958376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:26.021621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:26.023350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9ede-e4be-4953-a00f-b7dc1056a34b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:26.049153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 650/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:28.553331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:28.553928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:28.553928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:28.555424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 662/1312] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:28.560413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c29ae-0fef-43ed-a9a8-6e267b302109 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:28.560798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c29ae-0fef-43ed-a9a8-6e267b302109 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:28.560967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c29ae-0fef-43ed-a9a8-6e267b302109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:28.649268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-468c29ae-0fef-43ed-a9a8-6e267b302109 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:28.650492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-468c29ae-0fef-43ed-a9a8-6e267b302109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:28.750169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 651/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:29.031812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:29.033374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:29.147032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78455d-d882-4ada-92f7-a79776190eff None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:29.219634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:29.222101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:29.222896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:29.224050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:29.224531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:29.226228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:29.337336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:29.338919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519daec-d2d4-40fa-bb8d-45e83bd56c5f service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:29.357259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 663/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:31.814428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498287-480a-473d-9207-8c3bd968360a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:31.814981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498287-480a-473d-9207-8c3bd968360a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:31.814981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498287-480a-473d-9207-8c3bd968360a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:31.816332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 652/1315] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:31.822320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405722-5415-41db-ad98-ad14fecae946 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:31.822764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405722-5415-41db-ad98-ad14fecae946 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:31.822864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405722-5415-41db-ad98-ad14fecae946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:31.887584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f6405722-5415-41db-ad98-ad14fecae946 None None] MFA Rules not processed for user `5cf91871099347a1a436250895505724`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:31.888784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f6405722-5415-41db-ad98-ad14fecae946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:31.940217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:31.984678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 664/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:32.274785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94498287-480a-473d-9207-8c3bd968360a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:32.276323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-94498287-480a-473d-9207-8c3bd968360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:32.286617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:32.379029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94498287-480a-473d-9207-8c3bd968360a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:32.452176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:32.452780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:32.453059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:32.453329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:32.454943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:32.517413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:32.564388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:32.565864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374add-3fc5-4383-b2fa-84703bf84e6f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:32.585609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 653/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:35.375503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a070-d383-40f0-a376-6d562c1233f5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:35.376017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a070-d383-40f0-a376-6d562c1233f5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:35.376017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a070-d383-40f0-a376-6d562c1233f5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:35.377305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 665/1318] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:35.383117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440014-b2fe-4c9a-b856-59ef7e4f3864 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:35.383548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440014-b2fe-4c9a-b856-59ef7e4f3864 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:35.383674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe440014-b2fe-4c9a-b856-59ef7e4f3864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:35.448617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fe440014-b2fe-4c9a-b856-59ef7e4f3864 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:35.449851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fe440014-b2fe-4c9a-b856-59ef7e4f3864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:35.545531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 654/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:35.847111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:35.847395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:35.847670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:35.849599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 666/1320] 10.222.0.26 () {54 vars in 964 bytes} [Thu Sep 29 02:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:03:35.855327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00e20-3ebf-4d32-a127-e9f51c5b6cb3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:35.855621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00e20-3ebf-4d32-a127-e9f51c5b6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:35.855900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00e20-3ebf-4d32-a127-e9f51c5b6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:35.878290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:35.932587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-afa00e20-3ebf-4d32-a127-e9f51c5b6cb3 None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:35.933828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-afa00e20-3ebf-4d32-a127-e9f51c5b6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:36.007117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 655/1321] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Sep 29 02:03:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:36.016108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:36.017730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:36.124598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8944c9-31ab-45c0-90f8-85d9089d89b7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:36.196947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:36.197589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:36.197868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:36.198134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:36.199693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:36.206416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:36.308174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:36.309649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300479bf-8752-4e6f-99fb-25296f191eb3 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:36.327675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 667/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:03:39.617129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:39.617718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:39.617718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:39.619071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 656/1323] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:39.624882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b2a63-bf31-41c8-98b6-7f8f1ca5b53b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:39.625410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b2a63-bf31-41c8-98b6-7f8f1ca5b53b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:39.625537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b2a63-bf31-41c8-98b6-7f8f1ca5b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:39.699658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-667b2a63-bf31-41c8-98b6-7f8f1ca5b53b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:39.700895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-667b2a63-bf31-41c8-98b6-7f8f1ca5b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:39.765077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:39.806232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 668/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:40.086126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:40.087635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:40.197159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488713d-cc55-406e-9e55-9168b77f1ffc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:40.209469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:40.271588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:40.272194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:40.272473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:40.272764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:40.274357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:40.385210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:40.386685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf691-593b-463f-9d8c-293137dcbae8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:40.404050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 657/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:42.622742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:42.623299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:42.623397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:42.624739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 669/1326] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:42.630880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe10cb-b1c0-4841-8979-a81d6b92ba45 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:42.631285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe10cb-b1c0-4841-8979-a81d6b92ba45 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:42.631569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe10cb-b1c0-4841-8979-a81d6b92ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:42.688306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:42.708185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2cbe10cb-b1c0-4841-8979-a81d6b92ba45 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:42.709383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2cbe10cb-b1c0-4841-8979-a81d6b92ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:42.809959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 658/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:43.097011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:43.098698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:43.205483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2019e7-a94e-4d71-ab91-cff94635ec5b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:43.278510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:43.279122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:43.279392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:43.279659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:43.281213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:43.297910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:43.391865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:43.393302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189802-5ffc-4f4b-895c-78d70c4483a3 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:43.411989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 670/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:45.619751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:45.620226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:45.620226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:45.621742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 659/1329] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:45.627475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e3f-6c58-4890-8c88-96e5cd0fa3e3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:45.627900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e3f-6c58-4890-8c88-96e5cd0fa3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:45.628034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71e3f-6c58-4890-8c88-96e5cd0fa3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:45.693590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-22e71e3f-6c58-4890-8c88-96e5cd0fa3e3 None None] MFA Rules not processed for user `5cf91871099347a1a436250895505724`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:45.694804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-22e71e3f-6c58-4890-8c88-96e5cd0fa3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:45.762293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:45.794896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 671/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:46.080782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:46.082696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:46.193431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3854-a436-4802-84d2-a66a146fdbc0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:46.214594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:46.268215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:46.268843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:46.269107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:46.270022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:46.271630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:46.379478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:46.380986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63296663-f970-456f-b9ff-b4ee31b74efe service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:46.399670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 660/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:48.790549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:48.791087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:48.791087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:48.792428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 672/1332] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:48.797647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1bab-46e5-4e7e-9fc2-ac2dc010a3b5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:48.798081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1bab-46e5-4e7e-9fc2-ac2dc010a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:48.798228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1bab-46e5-4e7e-9fc2-ac2dc010a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:48.866774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:48.869357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6d2d1bab-46e5-4e7e-9fc2-ac2dc010a3b5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:48.871096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d2d1bab-46e5-4e7e-9fc2-ac2dc010a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:48.966412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 661/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:49.254177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:49.255712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:49.358877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cabd1-ddd1-4167-bac5-d3e01c15921a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:49.433909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:49.434502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:49.434777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:49.435044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:49.436853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:49.464152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:49.546030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:49.547381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3fe86-5f13-4f8a-a366-7cddff1da5a8 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:49.565693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 673/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:51.778728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:51.779265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:51.779265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:51.780596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 662/1335] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:51.786369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db978da-3b55-4c05-a521-546e4e2a9159 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:51.786815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db978da-3b55-4c05-a521-546e4e2a9159 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:51.786912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db978da-3b55-4c05-a521-546e4e2a9159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:51.852418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2db978da-3b55-4c05-a521-546e4e2a9159 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:51.853659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2db978da-3b55-4c05-a521-546e4e2a9159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:51.926308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:51.948234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 674/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:03:52.235910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:52.237493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:52.339406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e06a-abf4-4959-9c30-636f7ff5ed7d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:52.367948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:52.413312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:52.413945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:52.414227 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:52.414501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:52.416078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:52.523820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:52.525181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8fccf-59f6-402c-9cf4-d2b404a9edbe service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:52.542767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 663/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:54.997481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:54.998094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:54.998094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:54.999306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 675/1338] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:55.004980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230831-0d66-45dd-8f81-02a6965067f6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:55.005440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230831-0d66-45dd-8f81-02a6965067f6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:55.005569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230831-0d66-45dd-8f81-02a6965067f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:55.070980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5f230831-0d66-45dd-8f81-02a6965067f6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:55.072179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f230831-0d66-45dd-8f81-02a6965067f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:55.080258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:55.167303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 664/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:55.453783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:55.455323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:55.557693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda7c-84fb-49ae-9b70-13a4cfeda601 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:55.630042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:55.630645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:55.630922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:55.631192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:55.632745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:55.667570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:55.741977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:55.743338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062cc8-662f-4872-ae27-1e01ad39f051 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:55.762091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 676/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:59.871173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:59.871660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:59.871893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:59.873395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 665/1341] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:59.879571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50848-60a5-49c5-8489-40bb10f53a2f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:59.880020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50848-60a5-49c5-8489-40bb10f53a2f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:59.880120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50848-60a5-49c5-8489-40bb10f53a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:59.952067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c2c50848-60a5-49c5-8489-40bb10f53a2f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:59.953556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c2c50848-60a5-49c5-8489-40bb10f53a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:00.047495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:00.060057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 677/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:00.344892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:00.346550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:00.450228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1558-d08f-4948-a9d9-09b502a0b71a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:00.489933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:00.526177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:00.526861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:00.527143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:00.527414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:00.528998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:00.638057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:00.639501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27046e7c-d171-41f7-82b0-755b89bd066a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:00.659105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 666/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:03.386662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:03.387230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:03.387230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:03.388568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 678/1344] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:03.394479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07addb47-41bc-4fce-bb6a-bb23eff9be43 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:03.394960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07addb47-41bc-4fce-bb6a-bb23eff9be43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:03.395260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07addb47-41bc-4fce-bb6a-bb23eff9be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:03.460240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-07addb47-41bc-4fce-bb6a-bb23eff9be43 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:03.461726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-07addb47-41bc-4fce-bb6a-bb23eff9be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:03.479896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:03.559630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 667/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:03.844629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:03.846244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:03.955513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7f77-cbe9-46de-83af-9a8b187f16eb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:04.033852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:04.035124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:04.035481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:04.035758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:04.037330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:04.080244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:04.152444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:04.153931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16959853-197a-49a2-b001-a4639ee0fc18 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:04.173584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 679/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:08.381596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:08.382075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:08.382187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:08.383483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 668/1347] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:08.388819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f68b-6b50-48fd-94f6-c52534466fda None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:08.389258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f68b-6b50-48fd-94f6-c52534466fda None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:08.389560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f68b-6b50-48fd-94f6-c52534466fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:08.454411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-77a5f68b-6b50-48fd-94f6-c52534466fda None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:08.456126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-77a5f68b-6b50-48fd-94f6-c52534466fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:08.549704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:08.552321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 680/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:08.834961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:08.836788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:08.947486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763532-0ac6-44bf-a483-8d0d84aa78da None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:08.996280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:09.022445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:09.023045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:09.023320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:09.023596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:09.025155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:09.134160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:09.135599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdbea6-e5b0-4034-ad56-34f85abad37a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:09.153243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 669/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:14.044998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320a31-f44b-4d11-a64d-c00164a9b4c5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:14.044998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320a31-f44b-4d11-a64d-c00164a9b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:14.044998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320a31-f44b-4d11-a64d-c00164a9b4c5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:14.044998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 681/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:14.048818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd35-48b5-4032-a405-05a368c03ded None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:14.048818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd35-48b5-4032-a405-05a368c03ded None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:14.048818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd35-48b5-4032-a405-05a368c03ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:14.166482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3f5bcd35-48b5-4032-a405-05a368c03ded None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:14.168030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f5bcd35-48b5-4032-a405-05a368c03ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:14.229887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:14.307179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 670/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:18.583727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da547bd-43cf-4ca9-8cf9-d29e3e8fb9f9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:18.584246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da547bd-43cf-4ca9-8cf9-d29e3e8fb9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:18.584329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da547bd-43cf-4ca9-8cf9-d29e3e8fb9f9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:18.586158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 682/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:18.591609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa50b8-8473-4f1e-9a9f-a02154008400 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:18.592434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa50b8-8473-4f1e-9a9f-a02154008400 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:18.592893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa50b8-8473-4f1e-9a9f-a02154008400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:18.673772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-33aa50b8-8473-4f1e-9a9f-a02154008400 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:18.675355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33aa50b8-8473-4f1e-9a9f-a02154008400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:18.750879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:18.792103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 671/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:20.039384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9517-f4aa-4e3a-9e43-e79ff7b27a2a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:20.039972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9517-f4aa-4e3a-9e43-e79ff7b27a2a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:20.039972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9517-f4aa-4e3a-9e43-e79ff7b27a2a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:20.041246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 683/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:20.046323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72631c0-187d-43d2-8833-1dd5c4d42779 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:20.046742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72631c0-187d-43d2-8833-1dd5c4d42779 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:20.046885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72631c0-187d-43d2-8833-1dd5c4d42779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:20.129269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a72631c0-187d-43d2-8833-1dd5c4d42779 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:20.130504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a72631c0-187d-43d2-8833-1dd5c4d42779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:20.238500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 672/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:23.889224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692a3b-e329-4c4f-a16c-ef92d7a20979 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:23.889868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692a3b-e329-4c4f-a16c-ef92d7a20979 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:23.889868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692a3b-e329-4c4f-a16c-ef92d7a20979 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:23.891114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 684/1356] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:23.897759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdecf-8b7f-4ba8-993c-cd90f3e5e37f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:23.897759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdecf-8b7f-4ba8-993c-cd90f3e5e37f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:23.897759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdecf-8b7f-4ba8-993c-cd90f3e5e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:23.935778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:23.968110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5bcfdecf-8b7f-4ba8-993c-cd90f3e5e37f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:23.969300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5bcfdecf-8b7f-4ba8-993c-cd90f3e5e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:24.075218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 673/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:24.387032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:24.387770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:24.388267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:24.390315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 685/1358] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:24.399037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4697d-7c17-408b-ba01-e5fd397388d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:24.399326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4697d-7c17-408b-ba01-e5fd397388d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:24.399601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4697d-7c17-408b-ba01-e5fd397388d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:24.496689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-baf4697d-7c17-408b-ba01-e5fd397388d1 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:24.498829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-baf4697d-7c17-408b-ba01-e5fd397388d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:24.558588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:24.628503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 674/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:04:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:24.636257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:24.637980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:24.822507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b015-5377-4046-83db-ee6760a338e9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:24.903068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:24.945479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:24.946123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:24.946407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:24.946682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:24.948303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:25.052749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:25.054524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cb5c5-992d-4239-bc60-df463d1dee41 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:25.075010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 686/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:27.496863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:27.497567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:27.497567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:27.503179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 675/1361] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:27.504518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ba02-3b4e-4301-896d-40e022d5cde3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:27.504993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ba02-3b4e-4301-896d-40e022d5cde3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:27.504993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ba02-3b4e-4301-896d-40e022d5cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:27.580778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a243ba02-3b4e-4301-896d-40e022d5cde3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:27.582420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a243ba02-3b4e-4301-896d-40e022d5cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:27.624385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:27.692578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 687/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:27.985242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:27.987513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:28.170749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1461c6-8203-47f3-812a-1ec222c8fe5d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:28.182290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:28.309114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:28.309794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:28.310083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:28.310357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:28.311935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:28.407230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:28.409392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8326c-3290-4f97-9496-c24473014166 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:28.429704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 676/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:30.925348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3750-c336-44e7-aa35-a94059dcdbac None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.926253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3750-c336-44e7-aa35-a94059dcdbac None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.926707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3750-c336-44e7-aa35-a94059dcdbac None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.928487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 688/1364] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:04:30.933930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ad75-f29c-4da1-9adf-a8412043ff55 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.934686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ad75-f29c-4da1-9adf-a8412043ff55 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.935116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ad75-f29c-4da1-9adf-a8412043ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.952136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.007485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-22f8ad75-f29c-4da1-9adf-a8412043ff55 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:31.008691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22f8ad75-f29c-4da1-9adf-a8412043ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:31.120602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 677/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:31.416076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:31.416788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:31.417402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:31.419333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 689/1366] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:31.424364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24135-497d-4bdd-b974-f2983dfef1c0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:31.424648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24135-497d-4bdd-b974-f2983dfef1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:31.424956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24135-497d-4bdd-b974-f2983dfef1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:31.504625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5da24135-497d-4bdd-b974-f2983dfef1c0 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:31.505877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5da24135-497d-4bdd-b974-f2983dfef1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:31.542049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.629172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 678/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:31.636880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:31.638700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:31.796118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54d7d-64fe-42f3-88c3-f5fed60f7f38 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:31.819775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.921484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:31.922154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:31.922434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:31.922704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:31.924817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:32.026327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:32.027945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356d43-f072-4a18-aa89-63be4d11795e service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:32.046675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 690/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:32.075674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb2fe-38f4-4ca2-9cc5-f0756fbb6947 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.076281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb2fe-38f4-4ca2-9cc5-f0756fbb6947 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.076504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb2fe-38f4-4ca2-9cc5-f0756fbb6947 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.081622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 679/1369] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:32.085299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d0e3-7380-4001-8aad-2715512364b2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.085648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d0e3-7380-4001-8aad-2715512364b2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.085928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d0e3-7380-4001-8aad-2715512364b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.132109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:32.176589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-29c2d0e3-7380-4001-8aad-2715512364b2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:32.177912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-29c2d0e3-7380-4001-8aad-2715512364b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:32.303796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 691/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:32.651096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.651389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.651669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.653251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 680/1371] 10.222.0.26 () {54 vars in 963 bytes} [Thu Sep 29 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:32.658324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322edf23-12f7-4cd2-b93d-17eba46aa0eb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.658721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322edf23-12f7-4cd2-b93d-17eba46aa0eb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.659099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322edf23-12f7-4cd2-b93d-17eba46aa0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.741897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-322edf23-12f7-4cd2-b93d-17eba46aa0eb None None] MFA Rules not processed for user `737a97e6d4b6419da95d4e1fc4618970`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:32.743267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-322edf23-12f7-4cd2-b93d-17eba46aa0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:32.795412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:32.828159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 692/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Sep 29 02:04:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:32.836116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:32.837888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:32.948949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31b0cf-8889-4766-a3f8-167d1da14116 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:32.997917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:33.035478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:33.036246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:33.036632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:33.037009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:33.038789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:33.231806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:33.238385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e6b15-0136-477e-863d-6e317d3665ea service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:33.258671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 681/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:34.340106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:34.340662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:34.340662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:34.342086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 693/1374] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:34.348003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5304-0b4a-4e79-8fa9-4901f3d9e279 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:34.348486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5304-0b4a-4e79-8fa9-4901f3d9e279 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:34.348595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5304-0b4a-4e79-8fa9-4901f3d9e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:34.419125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d47e5304-0b4a-4e79-8fa9-4901f3d9e279 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:34.420332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d47e5304-0b4a-4e79-8fa9-4901f3d9e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:34.442585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:34.522522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 682/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:34.824071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:34.825680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:35.011407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73f5c-daaa-49b4-b000-2113fd2fe5c1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:35.072158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:35.153707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:35.154337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:35.154613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:35.154882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:35.156527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:35.260609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:35.262428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb219fb-1f48-442f-b6eb-a5adc059b7fa service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:35.283263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 694/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:37.536028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:37.536610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:37.536872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:37.538524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 683/1377] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:37.543539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaeede-0df2-4244-92bb-911fd31f1f16 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:37.543935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaeede-0df2-4244-92bb-911fd31f1f16 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:37.544119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaeede-0df2-4244-92bb-911fd31f1f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:37.613235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-93aaeede-0df2-4244-92bb-911fd31f1f16 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:37.614523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-93aaeede-0df2-4244-92bb-911fd31f1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:37.622132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:37.728499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 695/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:38.019294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:38.021120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:38.181526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ebdc4-2c1b-4f82-9be8-bb417dba4b8d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:38.185991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:38.304828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:38.305395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:38.305703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:38.305973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:38.307547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:38.402563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:38.404276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b4da-bad1-4fbe-9800-e2cf150adbb1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:38.426120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 684/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:40.653625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:40.654198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:40.654500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:40.656089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 696/1380] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:40.662109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0116-81f6-4b82-9854-7d4599c23f64 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:40.662578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0116-81f6-4b82-9854-7d4599c23f64 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:40.662664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0116-81f6-4b82-9854-7d4599c23f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:40.675620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:40.742013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-801d0116-81f6-4b82-9854-7d4599c23f64 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:40.743211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-801d0116-81f6-4b82-9854-7d4599c23f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:40.857672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 685/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:41.155844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:41.158002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:41.297238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:41.307969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146395d-db8f-4be4-b1d0-7abee5566735 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:41.430461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:41.431087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:41.431416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:41.431733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:41.433413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:41.527397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:41.529056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a747-e63a-4f3c-a08b-27a47e583e52 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:41.542553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:41.556062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 697/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:04:43.784906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:43.785422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:43.785422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:43.786744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 686/1383] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:43.792066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7afb9c-b900-478d-9d3c-b2839b22d8e5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:43.792603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7afb9c-b900-478d-9d3c-b2839b22d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:43.792708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7afb9c-b900-478d-9d3c-b2839b22d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:43.860108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8b7afb9c-b900-478d-9d3c-b2839b22d8e5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:43.861730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8b7afb9c-b900-478d-9d3c-b2839b22d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:43.967260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 698/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:44.301391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:44.302992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:44.392071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:44.460878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9e31-7912-4717-b8be-03673780d00d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:44.590168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:44.590786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:44.591067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:44.591339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:44.592934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:44.645681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:44.685633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:44.687240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d6a6-5d2f-4b39-81ed-56d58647712a service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:44.710191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 687/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:46.885892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:46.886550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:46.886550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:46.887778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 699/1386] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:46.893010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be34d-ad1b-45d2-9910-4588c54d019d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:46.893455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be34d-ad1b-45d2-9910-4588c54d019d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:46.893824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be34d-ad1b-45d2-9910-4588c54d019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:46.974262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5f7be34d-ad1b-45d2-9910-4588c54d019d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:46.975758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f7be34d-ad1b-45d2-9910-4588c54d019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:47.088086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 688/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:47.382203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:47.384162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:47.486240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:47.561488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc6ef-5421-4c29-94a4-59bf1c5722ae None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:47.691157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:47.693069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:47.693570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:47.693996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:47.695973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:47.751628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:47.817287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:47.819931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc88e6-fa51-4e42-aa69-e208ce3e3162 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:47.848232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 700/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:50.083776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.084345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.084345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.085882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 689/1389] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:50.091159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e116-fdc4-41ba-a711-d1c612737ac5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.091628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e116-fdc4-41ba-a711-d1c612737ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.091726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e116-fdc4-41ba-a711-d1c612737ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.161137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-03c2e116-fdc4-41ba-a711-d1c612737ac5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:50.162400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-03c2e116-fdc4-41ba-a711-d1c612737ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.269911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 701/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:50.562231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:50.563768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.598775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:50.721470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a114f2a-9617-4746-abde-d33583fb3a4c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:50.832126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:50.844742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:50.845352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.845662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.845933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.848072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.942495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:50.944098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6474023-6205-4061-8496-dd9013fdc4d6 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:50.962523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 690/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:52.625029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d425-c3ba-49b7-8cb6-7d26bd9e1dcc None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:52.625632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d425-c3ba-49b7-8cb6-7d26bd9e1dcc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:52.625632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d425-c3ba-49b7-8cb6-7d26bd9e1dcc None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:52.626981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 702/1392] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:52.632235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab2b8-6632-4210-aa0c-d88f3caf441a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:52.632671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab2b8-6632-4210-aa0c-d88f3caf441a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:52.632936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab2b8-6632-4210-aa0c-d88f3caf441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:52.699806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-876ab2b8-6632-4210-aa0c-d88f3caf441a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:52.701036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-876ab2b8-6632-4210-aa0c-d88f3caf441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:52.762218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:52.801723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 691/1393] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:53.103999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431a54-01be-4e0a-8050-76cd1f799a30 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.104291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431a54-01be-4e0a-8050-76cd1f799a30 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.104572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431a54-01be-4e0a-8050-76cd1f799a30 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.105984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 703/1394] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 29 02:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:53.111416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.111775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.112192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.189222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] MFA Rules not processed for user `f19ed5110c5d43bf89d25d1c85d132b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:53.190649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:53.193972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42283cf-93a5-4b38-8ce8-506fe1b03b3f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.194264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42283cf-93a5-4b38-8ce8-506fe1b03b3f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.194542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42283cf-93a5-4b38-8ce8-506fe1b03b3f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.195876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 704/1395] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:04:53.201110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.201395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.201708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.219030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:53.270848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 692/1396] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 29 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:53.271368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:53.272590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:53.279863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:53.288093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829d9b-a4cb-45f4-b34c-a4732b45ae09 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:53.343023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:53.366786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:53.367391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.367666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.367945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.369545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:53.375882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 705/1397] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:53.479635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:53.481064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee695-23c8-4c50-abe2-ccfcd5c24891 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:53.499194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 693/1398] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:04:53.671275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:53.672499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:53.770428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:53.796790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adcc53-f813-4a77-910f-7280d52a6209 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:53.921720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:53.922233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:53.922507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:53.922773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:53.924344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:54.013886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:54.016414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:54.018088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6192f-3263-4a78-8134-24232ddcd441 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:54.038740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 706/1399] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:54.259877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade4e2e-7729-4b06-b772-ed79f7b026ac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.260443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade4e2e-7729-4b06-b772-ed79f7b026ac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.260443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade4e2e-7729-4b06-b772-ed79f7b026ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.332102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5ade4e2e-7729-4b06-b772-ed79f7b026ac None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:54.333246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ade4e2e-7729-4b06-b772-ed79f7b026ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:54.371234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:54.424356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 694/1400] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:54.467760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.468053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.468329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.469710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 707/1401] 10.222.0.26 () {54 vars in 943 bytes} [Thu Sep 29 02:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:54.476158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533ae3-5a4d-447d-8c1f-546ca01fcadf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.476455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533ae3-5a4d-447d-8c1f-546ca01fcadf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.476730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533ae3-5a4d-447d-8c1f-546ca01fcadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.555868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-86533ae3-5a4d-447d-8c1f-546ca01fcadf None None] MFA Rules not processed for user `33c9ac2314b84688b03c1e9f2924595b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:54.557062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-86533ae3-5a4d-447d-8c1f-546ca01fcadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:54.663787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 695/1402] 10.222.0.26 () {58 vars in 1040 bytes} [Thu Sep 29 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:54.673086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:54.674871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:54.815850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461042c8-6b2e-4fa8-9d35-8158d97110f5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:54.887683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:54.921078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:54.921722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.922002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.922272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.923878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:55.013010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:55.014572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf7c1d-44b5-46f9-adc6-8b4ea29343fe service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:55.023857 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 708/1403] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:04:56.280818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:56.281422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:56.281422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:56.282915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 696/1404] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:56.288166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec713d5-a6ed-4f69-b640-6bfd7f3d7928 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:56.288676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec713d5-a6ed-4f69-b640-6bfd7f3d7928 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:56.288676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec713d5-a6ed-4f69-b640-6bfd7f3d7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:56.359981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-aec713d5-a6ed-4f69-b640-6bfd7f3d7928 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:56.361120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-aec713d5-a6ed-4f69-b640-6bfd7f3d7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:56.424877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:56.467164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 709/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:56.770430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:56.771958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:56.784639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:56.938942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a93a-3e31-4a10-8c4d-d041635bb04d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:57.035796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:57.074416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:57.075148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:57.075430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:57.075704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:57.077321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:57.185467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:57.187118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2223eb-4ed9-4b71-91ac-6470a75336a1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:57.208758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 697/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:59.454128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:59.454659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:59.454659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:59.457016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 710/1407] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:59.464082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2b9e1-d037-486c-bd62-386f50a6581d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:59.464558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2b9e1-d037-486c-bd62-386f50a6581d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:59.464667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2b9e1-d037-486c-bd62-386f50a6581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:59.537090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7ac2b9e1-d037-486c-bd62-386f50a6581d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:59.538359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ac2b9e1-d037-486c-bd62-386f50a6581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:59.589528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:59.655346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 698/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:59.954144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:59.955665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:00.120468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d652-2d7d-4a2a-82e3-8741e2575847 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:00.175195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:00.252154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:00.253324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:00.253645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:00.253923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:00.255551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:00.360200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:00.361863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b5003-a09d-4d1e-8912-7e97a055b5db service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:00.393697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 711/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:09.653801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=24 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:10.380329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=78 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:17.979838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eea3-0ce5-4261-b224-9093352fd108 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:17.980418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eea3-0ce5-4261-b224-9093352fd108 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:17.980418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eea3-0ce5-4261-b224-9093352fd108 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:17.981797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 699/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Sep 29 02:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:17.986745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda165-2262-4f32-bb1c-c4cbdd90d196 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:17.987236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda165-2262-4f32-bb1c-c4cbdd90d196 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:17.987343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda165-2262-4f32-bb1c-c4cbdd90d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:18.062763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cfeda165-2262-4f32-bb1c-c4cbdd90d196 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:18.063994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cfeda165-2262-4f32-bb1c-c4cbdd90d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:18.172339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 712/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Sep 29 02:05:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:18.187228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0495-e6fa-42f9-9cc0-4a0c83723eb7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:18.187515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0495-e6fa-42f9-9cc0-4a0c83723eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:18.187788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0495-e6fa-42f9-9cc0-4a0c83723eb7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:18.189092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 700/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Sep 29 02:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:18.193993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cd1c-6d41-4831-bc03-ff73c9419c45 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:18.194275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cd1c-6d41-4831-bc03-ff73c9419c45 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:18.194544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cd1c-6d41-4831-bc03-ff73c9419c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:18.383543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:18.386166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2f80cd1c-6d41-4831-bc03-ff73c9419c45 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:18.387934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2f80cd1c-6d41-4831-bc03-ff73c9419c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:18.503462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 713/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Sep 29 02:05:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:21.085342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:21.086171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:21.086171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:21.087422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:21.092664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aea0-c28f-4859-b6bf-7519c8f2d1b9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:21.093101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aea0-c28f-4859-b6bf-7519c8f2d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:21.093382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aea0-c28f-4859-b6bf-7519c8f2d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:21.159811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3fa9aea0-c28f-4859-b6bf-7519c8f2d1b9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:21.161701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3fa9aea0-c28f-4859-b6bf-7519c8f2d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:21.217609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:21.259722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:21.550502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:21.552116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:21.700348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c75c15-0eaf-40e3-ace1-1e9f023e5256 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:21.775352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:21.815913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:21.816423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:21.816704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:21.816979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:21.818606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:21.907140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:21.908745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832efc5f-0c56-48f2-b65a-81ae68d04978 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:21.926658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 702/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:23.066371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:23.066921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:23.066921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:23.068202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:23.074590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2c67-19c8-48d7-be4f-4163fe39f229 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:23.075012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2c67-19c8-48d7-be4f-4163fe39f229 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:23.075124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2c67-19c8-48d7-be4f-4163fe39f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:23.151971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b82e2c67-19c8-48d7-be4f-4163fe39f229 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:23.153185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b82e2c67-19c8-48d7-be4f-4163fe39f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:23.179566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:23.248949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:23.415262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:23.416808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:23.561396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b5f4-761a-41e3-85f5-c8f1ec55965b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:23.601783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:23.675533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:23.676067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:23.676344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:23.676613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:23.678232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:23.766064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:23.767641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69536f-3496-4ab5-8a7d-cc9b0f79bfb9 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:23.785712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 716/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:24.927699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:24.928293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:24.928293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:24.929581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:24.935655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952314-0825-469a-abed-f79bc03150a3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:24.936080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952314-0825-469a-abed-f79bc03150a3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:24.936242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952314-0825-469a-abed-f79bc03150a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:24.991026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:25.013100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c7952314-0825-469a-abed-f79bc03150a3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:25.014355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c7952314-0825-469a-abed-f79bc03150a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:25.112593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:25.266777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:25.268787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:25.415359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7400445-b3b0-46c9-a111-85d23a41e4c7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:25.427246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:25.529094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:25.529643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:25.529922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:25.530186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:25.531759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:25.622362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:25.623966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485dd17-3add-4942-8b70-da7f1399e8fe service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:25.641929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 705/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:26.761445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:26.761970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:26.762094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:26.763363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:26.769895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a31a7-3875-425a-a391-8735368106d0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:26.770373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a31a7-3875-425a-a391-8735368106d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:26.770485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a31a7-3875-425a-a391-8735368106d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:26.790784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:26.848160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2a4a31a7-3875-425a-a391-8735368106d0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:26.849375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a4a31a7-3875-425a-a391-8735368106d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:26.943828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:27.093254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:27.094878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:27.203899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:27.240073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65f63e-13d7-4b77-a96e-2a01df208c1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:27.351069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:27.351668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:27.351943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:27.352212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:27.353814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:27.428330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:27.442662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:27.444243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81bfd6-0c12-489e-bc47-4863cede667d service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:27.462729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 719/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:28.571224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:28.571774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:28.571774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:28.573060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:28.579436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870abfe7-63f2-4eb9-8be5-d64ddc07909c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:28.579844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870abfe7-63f2-4eb9-8be5-d64ddc07909c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:28.579992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870abfe7-63f2-4eb9-8be5-d64ddc07909c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:28.658037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-870abfe7-63f2-4eb9-8be5-d64ddc07909c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:28.659834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-870abfe7-63f2-4eb9-8be5-d64ddc07909c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:28.756871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:28.909983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:28.911515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:28.994677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:29.057218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc9c2-c92b-41d0-a65d-e8225379a619 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:29.174495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:29.175034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:29.175312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:29.175636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:29.177732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:29.224825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:29.266179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:29.267804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8836dc-86ee-4118-acb3-88b92e83bc8d service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:29.286151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 708/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:30.342519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:30.343063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:30.343063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:30.344398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:30.351401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6de077-fb24-4a3a-89ba-db8c3ab52891 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:30.351810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6de077-fb24-4a3a-89ba-db8c3ab52891 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:30.351935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6de077-fb24-4a3a-89ba-db8c3ab52891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:30.426402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cc6de077-fb24-4a3a-89ba-db8c3ab52891 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:30.427605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc6de077-fb24-4a3a-89ba-db8c3ab52891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:30.524509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:30.675565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:30.677632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:30.733077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:30.834313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b62cd-b9a5-4fa1-94a5-dc4f0e216c5e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:30.947023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:30.947540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:30.947825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:30.948098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:30.949737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:30.956754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.039843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:31.041450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc22bb2-d239-48eb-a25b-f3b874d30ef0 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:31.059979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 722/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:32.121061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:32.121535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:32.121653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:32.122974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:32.129795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a47ee-feb7-43f2-8cef-f951083c726d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:32.130263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a47ee-feb7-43f2-8cef-f951083c726d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:32.130369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a47ee-feb7-43f2-8cef-f951083c726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:32.206216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-293a47ee-feb7-43f2-8cef-f951083c726d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:32.208026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-293a47ee-feb7-43f2-8cef-f951083c726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:32.275444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:32.304666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:32.456052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:32.458243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:32.476897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:32.604040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe920-32e1-4450-aa51-34c012f0985d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:32.690435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:32.717636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:32.718243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:32.718579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:32.718804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:32.720397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:32.810394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:32.812003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1df0-a798-4a15-b013-6338faca4c96 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:32.830826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 711/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:33.887281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:33.887863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:33.887863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:33.889142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:33.896104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f94a-9771-4817-a16f-1b90ff5950de None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:33.896559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f94a-9771-4817-a16f-1b90ff5950de None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:33.896672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f94a-9771-4817-a16f-1b90ff5950de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:33.972077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8996f94a-9771-4817-a16f-1b90ff5950de None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:33.973973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8996f94a-9771-4817-a16f-1b90ff5950de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:34.014914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:34.069951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:34.220772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:34.222271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:34.370968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ad47-6b69-4039-b638-8aa697b9f52a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:34.424404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:34.483886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:34.484416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:34.484693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:34.484963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:34.486577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:34.575575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:34.577176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4a41b-0042-44ac-829d-23ee40cb2f10 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:34.595690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 725/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:35.689863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:35.690456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:35.690456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:35.692726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:35.700756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856ada-2286-4be0-a5fd-0ef24185b38c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:35.701292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856ada-2286-4be0-a5fd-0ef24185b38c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:35.701417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856ada-2286-4be0-a5fd-0ef24185b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:35.783956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b7856ada-2286-4be0-a5fd-0ef24185b38c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:35.785757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b7856ada-2286-4be0-a5fd-0ef24185b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:35.788440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.889622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:05:36.062828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:36.064441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:36.227710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c737c7-3f0c-4e9e-9f39-58e008d255ca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:36.255833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:36.341646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:36.342262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:36.342544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:36.342816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:36.344448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:36.433211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:36.434859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf498a-9df3-46f1-bedf-5d430a08b296 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:36.453171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 714/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:38.529791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:38.530337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:38.530337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:38.531601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:38.537646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95df2-b130-49c9-8a5d-65eb37539347 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:38.538087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95df2-b130-49c9-8a5d-65eb37539347 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:38.538252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95df2-b130-49c9-8a5d-65eb37539347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:38.577870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:38.604387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eaa95df2-b130-49c9-8a5d-65eb37539347 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:38.605702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eaa95df2-b130-49c9-8a5d-65eb37539347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:38.700594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:39.000982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:39.002551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:39.107706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbd0c-b993-4407-b697-5b17896e5d17 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:39.139836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:39.182479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:39.183082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:39.183363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:39.183633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:39.185206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:39.292171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:39.293529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35562-96b4-4822-980c-8e9a9618de98 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:39.311657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 728/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:41.687355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:41.687949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:41.687949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:41.689213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:41.695487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290ee8-18e5-4a21-8a11-87569ec5d128 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:41.695940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290ee8-18e5-4a21-8a11-87569ec5d128 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:41.696047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290ee8-18e5-4a21-8a11-87569ec5d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:41.763720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-da290ee8-18e5-4a21-8a11-87569ec5d128 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:41.764922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-da290ee8-18e5-4a21-8a11-87569ec5d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:41.777644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:41.861492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:42.148534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:42.150088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:42.253063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f8267-6cf3-41cd-8293-0f92dd4f6419 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:42.266053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:42.328868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:42.329464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:42.329771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:42.330038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:42.332092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:42.438886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:42.440238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760101b-d8c7-490a-a2e9-ed096bf302aa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:42.458700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 717/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:44.986828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:44.987375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:44.987375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:44.989042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:44.994634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39da5-43b8-4ada-b579-91e00df48331 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:44.995068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39da5-43b8-4ada-b579-91e00df48331 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:44.995182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39da5-43b8-4ada-b579-91e00df48331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:45.043170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:45.060844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-36d39da5-43b8-4ada-b579-91e00df48331 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:45.062064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-36d39da5-43b8-4ada-b579-91e00df48331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:45.160558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:45.447506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:45.449075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:45.552044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f4db-0bca-486f-a625-d9cfc6ad2fc8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:45.591101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:45.627363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:45.627977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:45.628261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:45.628636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:45.630351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:45.739454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:45.740811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa3527-4969-4804-ae33-476eb36accb9 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:45.758324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 731/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:48.065099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:48.065692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:48.065692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:48.067730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:48.073137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d0a-7020-4418-ac10-8b8d021e09d5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:48.073598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d0a-7020-4418-ac10-8b8d021e09d5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:48.073755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d0a-7020-4418-ac10-8b8d021e09d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:48.142206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-af6e5d0a-7020-4418-ac10-8b8d021e09d5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:48.143406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-af6e5d0a-7020-4418-ac10-8b8d021e09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:48.164408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:48.240059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:48.528551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:48.530152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:48.637159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e34fdb-4c1d-4214-836d-63ed37155945 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:48.657377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:48.711195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:48.712069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:48.712354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:48.712627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:48.714259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:48.824842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:48.826222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1dee-b7c4-4862-abe4-8556d1985c15 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:48.844239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 720/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:51.072012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:51.072554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:51.072554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:51.073855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:51.079361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575802-044c-4760-93ae-b2c3bcf04ec8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:51.079783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575802-044c-4760-93ae-b2c3bcf04ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:51.079912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575802-044c-4760-93ae-b2c3bcf04ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:51.144460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:51.147606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8f575802-044c-4760-93ae-b2c3bcf04ec8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:51.149316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f575802-044c-4760-93ae-b2c3bcf04ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:51.244693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:51.531761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:51.533321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:51.640632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36754-22ab-440b-a5c6-e0d4d50a4021 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:51.695139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:51.720856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:51.721471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:51.721784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:51.722576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:51.724477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:51.840039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:51.841393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327d76-5bee-405b-820a-6d4f3adbb11e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:51.859609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 734/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:54.069222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:54.069839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:54.069839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:54.071148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:54.076386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6d84-f878-4c06-8905-9a315e914c17 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:54.076838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6d84-f878-4c06-8905-9a315e914c17 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:54.076933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6d84-f878-4c06-8905-9a315e914c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:54.143551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2a1c6d84-f878-4c06-8905-9a315e914c17 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:54.145260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a1c6d84-f878-4c06-8905-9a315e914c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:54.175258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:54.243603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:54.530654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:54.532192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:54.634179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa050bcb-09f0-45d2-b512-37e3a9d438e6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:54.662380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:54.707744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:54.708353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:54.708636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:54.708912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:54.710546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:54.819614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:54.820962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76784b5-911e-4071-bf17-a2dcb069d04b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:54.839592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 723/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:57.077875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:57.078399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:57.078399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:57.079797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:57.086201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e871-3547-4f1c-bcf7-d23043da761e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:57.086936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e871-3547-4f1c-bcf7-d23043da761e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:57.087048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e871-3547-4f1c-bcf7-d23043da761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:57.153826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d331e871-3547-4f1c-bcf7-d23043da761e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:57.155026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d331e871-3547-4f1c-bcf7-d23043da761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:57.163522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:57.251650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:57.544843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:57.546404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:57.647477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2efc-08a0-48c9-b5ee-ae56524bfd48 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:57.701769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:57.720038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:57.720633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:57.720908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:57.721175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:57.723523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:57.830687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:57.832197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63c8d-1c6f-4cc6-a97b-5bf13e53d587 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:57.850990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 737/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:00.058110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:00.058695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:00.058695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:00.060013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:00.065229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe37-9f0e-4992-b8f5-ac93569f3826 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:00.065696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe37-9f0e-4992-b8f5-ac93569f3826 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:00.065865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe37-9f0e-4992-b8f5-ac93569f3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:00.132505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a2cdbe37-9f0e-4992-b8f5-ac93569f3826 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:00.133748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a2cdbe37-9f0e-4992-b8f5-ac93569f3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:00.172122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:00.231625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:00.517300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:00.518910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:00.621345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b17bd-d32f-428d-b327-a69dec4cf8d6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:00.657756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:00.694087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:00.694690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:00.695014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:00.695291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:00.696863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:00.808313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:00.809705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6a76-4fe0-4a2d-b818-9b8ca3b7e3df service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:00.828267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 726/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:03.006434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:03.007012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:03.007012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:03.008248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:03.013690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da719d-c779-40b9-9534-66a91fd1fedf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:03.014150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da719d-c779-40b9-9534-66a91fd1fedf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:03.014254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da719d-c779-40b9-9534-66a91fd1fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:03.078925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-61da719d-c779-40b9-9534-66a91fd1fedf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:03.080115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-61da719d-c779-40b9-9534-66a91fd1fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:03.099072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:03.178424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:03.459116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:03.460780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:03.563234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd2e1-70d9-4ba3-90dc-d268a3eebc4c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:03.631040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:03.637690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:03.638296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:03.638572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:03.638840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:03.640394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:03.748246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:03.749620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5768f-8459-4af4-84b7-d1f62544fec4 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:03.767281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 740/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:05.959320 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:05.959938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:05.960042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:05.961371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:05.967421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868239-13c0-47e7-a374-946f104e8c79 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:05.967877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868239-13c0-47e7-a374-946f104e8c79 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:05.967982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868239-13c0-47e7-a374-946f104e8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:06.032978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2d868239-13c0-47e7-a374-946f104e8c79 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:06.034226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d868239-13c0-47e7-a374-946f104e8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:06.082267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:06.132012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:06.419139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:06.420690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:06.523888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61bb47-aa7b-426e-b0b9-bc3ec400e3ca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:06.571536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:06.600105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:06.600712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:06.601000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:06.601273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:06.602889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:06.710231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:06.711582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a23e3-44f7-4473-a9de-789e5f25c424 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:06.730306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 729/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:16.130485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=22 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:16.728059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=66 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:26.847600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9dbf-005d-402d-9d96-196fcb79bfd9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:26.848184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9dbf-005d-402d-9d96-196fcb79bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:26.848184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9dbf-005d-402d-9d96-196fcb79bfd9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:26.849497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 742/1471] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:26.854851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cdf22-4234-4ea0-b5e9-9236dec8359a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:26.855298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cdf22-4234-4ea0-b5e9-9236dec8359a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:26.855412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cdf22-4234-4ea0-b5e9-9236dec8359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.043665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f57cdf22-4234-4ea0-b5e9-9236dec8359a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:27.044874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f57cdf22-4234-4ea0-b5e9-9236dec8359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:27.142698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 730/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:27.442992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:27.443298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:27.443565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.444892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 743/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 29 02:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:27.449851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0ff16-4fda-40ce-bd71-138bc2819c81 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:27.450138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0ff16-4fda-40ce-bd71-138bc2819c81 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:27.450415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0ff16-4fda-40ce-bd71-138bc2819c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.525935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6dd0ff16-4fda-40ce-bd71-138bc2819c81 None None] MFA Rules not processed for user `f19ed5110c5d43bf89d25d1c85d132b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:27.527123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6dd0ff16-4fda-40ce-bd71-138bc2819c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:27.547362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:27.602914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 731/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 29 02:06:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:27.610734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:27.612280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:27.715304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae3c63-5880-4c5b-82e5-f4fbbbddaaa5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:27.788737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:27.789367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:27.789675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:27.789948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.791529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:27.845967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:27.900313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:27.901776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e71ab1-fa89-4e35-b403-b5236d8b3fd2 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:27.919692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 744/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:30.156662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:30.157181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:30.157291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:30.158629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 732/1476] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:30.164717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24b43-fe53-48d3-b210-668584f25dd1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:30.165119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24b43-fe53-48d3-b210-668584f25dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:30.165265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24b43-fe53-48d3-b210-668584f25dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:30.230774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-02f24b43-fe53-48d3-b210-668584f25dd1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:30.231964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02f24b43-fe53-48d3-b210-668584f25dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:30.326366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 745/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:30.603827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:30.605415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:30.727848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c9dc-8828-4dc3-8eda-e0f03c71d0f7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:30.779535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:30.824445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:30.825049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:30.825326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:30.825629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:30.826261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:30.828004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:06:30.828004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:06:30.828004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:06:30.829138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d616e-16e8-4687-8b08-0430c3136d5f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:30.848368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 733/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 29 02:06:30 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:06:33.030191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:33.030870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:33.030870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:33.032037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 746/1479] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:33.037920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde744-3fe9-447a-8ae1-c82446756f1e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:33.038394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde744-3fe9-447a-8ae1-c82446756f1e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:33.038501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde744-3fe9-447a-8ae1-c82446756f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:33.105160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8fcde744-3fe9-447a-8ae1-c82446756f1e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:33.106393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8fcde744-3fe9-447a-8ae1-c82446756f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:33.203261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 734/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:33.498230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:33.499850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:33.510758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:33.649074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e40246-4995-43a3-b6b4-f5e318144a1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:33.729003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:33.761793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:33.762413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:33.762693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:33.763037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:33.764824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:33.854544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:33.856144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d987415-f735-4cf3-ac68-6d176f377cc4 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:33.874266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 747/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:36.218224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:36.218790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:36.218790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:36.220093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 735/1482] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:36.225611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fba42-7d6e-4156-b1d3-d9a35df9b3a4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:36.226076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fba42-7d6e-4156-b1d3-d9a35df9b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:36.226191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fba42-7d6e-4156-b1d3-d9a35df9b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:36.296498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9d2fba42-7d6e-4156-b1d3-d9a35df9b3a4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:36.297755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d2fba42-7d6e-4156-b1d3-d9a35df9b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:36.345855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:36.400419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 748/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:36.748833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:36.750383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:36.776477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:36.867032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5cd7-e587-4b95-9bc9-a1ecfc652766 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:36.949350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:36.949989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:36.950266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:36.950537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:36.952122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:37.041437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:37.083827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:37.085285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8433f72-9330-4a73-8482-5c8acf9a832c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:37.107355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 736/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:39.341210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:39.341799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:39.341799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:39.343132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 749/1485] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:39.348740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb6-1df5-4e3a-b76c-b2446d842b5b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:39.349188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb6-1df5-4e3a-b76c-b2446d842b5b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:39.349294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb6-1df5-4e3a-b76c-b2446d842b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:39.414451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7c94efb6-1df5-4e3a-b76c-b2446d842b5b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:39.415566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c94efb6-1df5-4e3a-b76c-b2446d842b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:39.510765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 737/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:39.802132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:39.803658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:39.910256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fd2e6-7f11-4748-b7d1-b09cdc6fa0ec None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:39.982330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:39.984011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:39.984651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:39.985115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:39.985433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:39.987443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:40.095645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:40.098062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df107e-378e-42b1-84f2-cd01624fdfd0 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:40.116323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 750/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:42.421834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:42.422356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:42.422356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:42.423632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 738/1488] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:42.429065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dd1a-e7fe-433b-80dd-4212fe1015f0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:42.429582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dd1a-e7fe-433b-80dd-4212fe1015f0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:42.429700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dd1a-e7fe-433b-80dd-4212fe1015f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:42.495835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a587dd1a-e7fe-433b-80dd-4212fe1015f0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:42.497041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a587dd1a-e7fe-433b-80dd-4212fe1015f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:42.549345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:42.593907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 751/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:42.885736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:42.887293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:42.923164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:42.990675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb556-73d8-4542-8962-76e7fee0cf9e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:43.062397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:43.062927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:43.063201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:43.063466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:43.065735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:43.148516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:43.178132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:43.179563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa97bc-8a82-4c9a-93c4-feaab6852952 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:43.198258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 739/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:45.607896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:45.608452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:45.608452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:45.609839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 752/1491] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 29 02:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:45.616131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9246-0e05-4750-9088-b19ce3137a6d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:45.616565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9246-0e05-4750-9088-b19ce3137a6d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:45.616767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9246-0e05-4750-9088-b19ce3137a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:45.681656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a6d9246-0e05-4750-9088-b19ce3137a6d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:45.682856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a6d9246-0e05-4750-9088-b19ce3137a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:45.777878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 740/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:46.071109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:46.072657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:46.177393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7e0ce-6099-441d-9a9e-6fed1d502d97 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:46.250173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:46.250782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:46.251064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:46.251338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:46.253533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:46.262991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:46.363155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:46.364594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa98a-fb6c-43e9-8f04-d060d9d14c03 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:46.382091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 753/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:06:55.776335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:56.379932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=50 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:59.184840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.185383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.185383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.260869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:59.262104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.358158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 741/1494] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:59.366630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.367122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.367228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.441993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:59.443180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.543726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 754/1495] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:59.548681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:59.549920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.561164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982329-11b0-4dab-a760-ccc440ce129e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:59.622502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:59.657938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:59.658542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.658825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.659094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.659732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:07:59.660029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:59.661030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:59.661030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:07:59.661030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:07:59.661949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:59.673129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 742/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:07:59.681639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:59.690825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1ec70-be63-4dd2-be0f-9909f33b8363 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:59.752469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:59.786800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:59.787423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.787717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.787986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.788617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:59.790396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:59.790396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:07:59.790396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:07:59.791582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:59.848417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 755/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:07:59 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:07:59.852646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:59.854145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.887754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394681-6ff1-4c41-ac2f-02b423e27b02 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:59.980223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:59.980827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.981102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.981371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.982040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:59.983045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:59.983045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:07:59.983045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:07:59.984253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:00.026634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 743/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:07:59 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:08:00.030922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:00.033183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.095846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ab00-69aa-4362-b56f-adcf4d4058f3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:00.180176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:00.191358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:00.191964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.192241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.192507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.193143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:00.194188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:08:00.194188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:08:00.194188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:08:00.195074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:00.207821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 756/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:08:00.211914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:00.213734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.225897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c280-d7e9-47a4-8085-98e2157c1ec6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:00.250769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:00.319885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:00.320491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.320768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.321039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.321710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:00.322719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:08:00.322719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:08:00.322719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:08:00.323608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb53cfe-87ec-4ac8-943f-743b95b022c2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:00.336119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 744/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:08:00.340741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:00.342284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.376197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d3db-3c60-4a45-9a8a-7063e0c78b58 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:00.469888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:00.470548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.470834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.471105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] PATH_INFO: `/v3/projects/fcc33c57ad4e4403a12593eb3934d53b/users/254ce7d9d88c4551ab747de0057792d1/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.493153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc33c57ad4e4403a12593eb3934d53b, user_id=254ce7d9d88c4551ab747de0057792d1, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:00.494205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:08:00.494205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:08:00.494205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:08:00.496126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b3741-bbf0-4ac9-a4a5-185a14588fea admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:00.521022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 757/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:08:00 2022] PUT /identity/v3/projects/fcc33c57ad4e4403a12593eb3934d53b/users/254ce7d9d88c4551ab747de0057792d1/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:08:00.533180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a22d-6351-42c4-9890-76dce0379e0f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.533466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a22d-6351-42c4-9890-76dce0379e0f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.533778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a22d-6351-42c4-9890-76dce0379e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.590775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-68e4a22d-6351-42c4-9890-76dce0379e0f None None] MFA Rules not processed for user `254ce7d9d88c4551ab747de0057792d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:08:00.592007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68e4a22d-6351-42c4-9890-76dce0379e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.669082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 745/1502] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:08:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:08:00.682312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.682601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.682879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.684211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 758/1503] 10.222.0.26 () {54 vars in 963 bytes} [Thu Sep 29 02:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:08:00.689724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d972-a56e-4b13-bcc0-a7069fcbec68 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:00.690017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d972-a56e-4b13-bcc0-a7069fcbec68 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:00.690294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d972-a56e-4b13-bcc0-a7069fcbec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:00.722946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:00.768047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1b7d972-a56e-4b13-bcc0-a7069fcbec68 None None] MFA Rules not processed for user `737a97e6d4b6419da95d4e1fc4618970`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:08:00.769286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1b7d972-a56e-4b13-bcc0-a7069fcbec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.845100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 746/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Sep 29 02:08:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:08:00.853361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:00.854891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:00.904917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:00.959622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee49d4-69eb-4115-b572-76bd6e37d670 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:01.033792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:01.034301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:01.034579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:01.034849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:01.036489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:01.139226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:01.140653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:01.144392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:01.159164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 759/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:08:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:08:01.204833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017931-80f3-499c-b942-1e92a60bca65 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:01.205125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017931-80f3-499c-b942-1e92a60bca65 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:01.205396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017931-80f3-499c-b942-1e92a60bca65 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:01.206733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 747/1506] 10.222.0.26 () {52 vars in 830 bytes} [Thu Sep 29 02:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:08:01.210355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:01.211563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:01.311168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bd815-414a-4f0f-a674-6b2070b0cbf7 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:01.403104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:01.403740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:01.403994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:01.404267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] PATH_INFO: `/v3/users/254ce7d9d88c4551ab747de0057792d1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:01.417778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] RBAC: Authorizing `identity:delete_user(user_id=254ce7d9d88c4551ab747de0057792d1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:01.418804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:08:01.418804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:08:01.418804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:08:01.420027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:01.430518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:01.488819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254ce7d9d88c4551ab747de0057792d1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:01.502484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254ce7d9d88c4551ab747de0057792d1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:01.502923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254ce7d9d88c4551ab747de0057792d1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:01.513053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254ce7d9d88c4551ab747de0057792d1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:01.537273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254ce7d9d88c4551ab747de0057792d1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:01.543072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 760/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:08:01 2022] DELETE /identity/v3/users/254ce7d9d88c4551ab747de0057792d1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:08:01.548254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:01.548743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:01.548967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:01.605908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:08:01.607120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:01.682660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:01.695006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 748/1508] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:08:01.705367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:01.706632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:01.804455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3861cd-6495-44b2-954f-1756fff2654b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:01.857859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:01.878760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:01.879372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:01.879652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:01.879922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:01.881494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:01.988124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:01.989599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86fece-0b58-463e-ae83-35711c0ccf82 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:02.007589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 761/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:08:02.349771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:08:02.351016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:08:02.363087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938a4c-f257-4f89-96b3-616ac415d8f9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:08:02.459710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:08:02.460338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:08:02.460617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:08:02.461000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] PATH_INFO: `/v3/projects/fcc33c57ad4e4403a12593eb3934d53b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:08:02.471645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc33c57ad4e4403a12593eb3934d53b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:08:02.472672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:08:02.472672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:08:02.472672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:08:02.473916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:08:02.530401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc33c57ad4e4403a12593eb3934d53b', 'request_id': 'req-7154faf8-2355-4790-a860-bd5b78b08998'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:02.536898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc33c57ad4e4403a12593eb3934d53b', 'request_id': 'req-7154faf8-2355-4790-a860-bd5b78b08998'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:02.550893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc33c57ad4e4403a12593eb3934d53b', 'request_id': 'req-7154faf8-2355-4790-a860-bd5b78b08998'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:02.576577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] The token cache is being invalidate because project fcc33c57ad4e4403a12593eb3934d53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:08:02.576869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:02.577376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7154faf8-2355-4790-a860-bd5b78b08998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:08:02.579349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 749/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:08:02 2022] DELETE /identity/v3/projects/fcc33c57ad4e4403a12593eb3934d53b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:08:12.005376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=62 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:12.574356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:09:38.821896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:38.822530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:38.822530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:38.823795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:38.828772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425c9d-f1e1-4701-a8aa-fceb61db8aaf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:38.829198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425c9d-f1e1-4701-a8aa-fceb61db8aaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:38.829327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49425c9d-f1e1-4701-a8aa-fceb61db8aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:38.910618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49425c9d-f1e1-4701-a8aa-fceb61db8aaf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:38.911818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49425c9d-f1e1-4701-a8aa-fceb61db8aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:39.014561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:39.172123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:39.174392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:39.293623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb03ca-27ef-4652-8f45-eb026865118d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:39.299214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:39.299819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:39.300105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:39.300383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:39.308317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:39.309941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628839b-6e1e-4c88-9c2c-f8b81921389f service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:39.319417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 763/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:40.409261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a7e8-ba12-4759-8fd3-4aef2aa2abf9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:40.409826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a7e8-ba12-4759-8fd3-4aef2aa2abf9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:40.409826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a7e8-ba12-4759-8fd3-4aef2aa2abf9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:40.411098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:40.417695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643613c-4886-4b9b-96ec-037c7c8fe84f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:40.418131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643613c-4886-4b9b-96ec-037c7c8fe84f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:40.418330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643613c-4886-4b9b-96ec-037c7c8fe84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:40.440613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7643613c-4886-4b9b-96ec-037c7c8fe84f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:40.441845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7643613c-4886-4b9b-96ec-037c7c8fe84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:40.449970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:40.609553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a7e8-ba12-4759-8fd3-4aef2aa2abf9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:40.623533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a7e8-ba12-4759-8fd3-4aef2aa2abf9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:40.628983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:40.629621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:40.629903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:40.630175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:40.638083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:40.639654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc914f7-ea2a-49ff-9422-6f0eec50c46f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:40.649631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 752/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:40.821245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f6bf-ed4f-4207-aa67-7aa493381b36 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:40.821561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f6bf-ed4f-4207-aa67-7aa493381b36 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:40.821846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f6bf-ed4f-4207-aa67-7aa493381b36 None None] PATH_INFO: `/v3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:40.823114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 765/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu Sep 29 02:09:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:09:40.830053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e707b-c8ae-480d-a915-87408680ec44 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:40.830343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e707b-c8ae-480d-a915-87408680ec44 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:40.830619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e707b-c8ae-480d-a915-87408680ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:40.891364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a29e707b-c8ae-480d-a915-87408680ec44 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:40.892595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a29e707b-c8ae-480d-a915-87408680ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:40.909150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:09:40.963961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 753/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 29 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:44.575182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3985b15-c9aa-45f6-805e-0bd99357bfa9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:44.575679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3985b15-c9aa-45f6-805e-0bd99357bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:44.575778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3985b15-c9aa-45f6-805e-0bd99357bfa9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:44.577170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 766/1519] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:44.582737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064debf-cbab-4781-8ad7-f9d8424337f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:44.583184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064debf-cbab-4781-8ad7-f9d8424337f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:44.583276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064debf-cbab-4781-8ad7-f9d8424337f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:44.603838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a064debf-cbab-4781-8ad7-f9d8424337f7 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:44.605048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a064debf-cbab-4781-8ad7-f9d8424337f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:44.613749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 754/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:09:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:44.621366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3985b15-c9aa-45f6-805e-0bd99357bfa9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:44.635078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3985b15-c9aa-45f6-805e-0bd99357bfa9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:44.640592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:44.641189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:44.641468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:44.641770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:44.649933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:44.651499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc5ba5-63f3-4391-839d-d36986088834 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:44.661640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 767/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:52.126287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995135c5-a8dd-495b-b8c4-704406a60937 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:52.126815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995135c5-a8dd-495b-b8c4-704406a60937 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:52.126815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995135c5-a8dd-495b-b8c4-704406a60937 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:52.128163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:52.134395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454212-7ca5-461d-8c8c-cd2e10b4ae8a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:52.134844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454212-7ca5-461d-8c8c-cd2e10b4ae8a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:52.134952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454212-7ca5-461d-8c8c-cd2e10b4ae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:52.154585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-47454212-7ca5-461d-8c8c-cd2e10b4ae8a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:52.156520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-47454212-7ca5-461d-8c8c-cd2e10b4ae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:52.164310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:52.319317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995135c5-a8dd-495b-b8c4-704406a60937 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:52.334565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995135c5-a8dd-495b-b8c4-704406a60937 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:52.340246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:52.340844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:52.341125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:52.341413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:52.349589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:52.351225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98a174-2e6b-46d9-a85d-61ff2d812d5e service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:52.360517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 756/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:53.427628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009fa1-ef87-4d2d-97c7-8c28f1a7e155 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.428192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009fa1-ef87-4d2d-97c7-8c28f1a7e155 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.428192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009fa1-ef87-4d2d-97c7-8c28f1a7e155 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.429612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:53.435591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f128-89ca-4b4b-ac5d-b25f314a5aed None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.436045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f128-89ca-4b4b-ac5d-b25f314a5aed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.436162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f128-89ca-4b4b-ac5d-b25f314a5aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.456202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0ac3f128-89ca-4b4b-ac5d-b25f314a5aed None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:53.457380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ac3f128-89ca-4b4b-ac5d-b25f314a5aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:53.465615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:53.615529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009fa1-ef87-4d2d-97c7-8c28f1a7e155 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:53.629797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009fa1-ef87-4d2d-97c7-8c28f1a7e155 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:53.635195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:53.635787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.636070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.636343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.645472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:53.647157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb227-1dbb-4c72-8469-493f63886a12 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:53.657176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 770/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:57.953819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:57.954400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:57.954400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:57.955727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:57.960840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d48cb5-a919-4f8d-91a7-de78a9b0fd0f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:57.961274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d48cb5-a919-4f8d-91a7-de78a9b0fd0f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:57.961391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d48cb5-a919-4f8d-91a7-de78a9b0fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:57.982310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-01d48cb5-a919-4f8d-91a7-de78a9b0fd0f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:57.983513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-01d48cb5-a919-4f8d-91a7-de78a9b0fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:57.991527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:58.276874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:58.278608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:58.358464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a906-3d4c-4a66-a0e2-592c400563b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:58.362204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:58.362807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:58.363090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:58.363363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:58.372280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:58.373752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef821-8af7-43c5-8f96-51b082d3f407 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:58.383577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 759/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:00.523916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab829e3-b0a2-4728-bce0-0864dd72bb92 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.524495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab829e3-b0a2-4728-bce0-0864dd72bb92 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.524495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab829e3-b0a2-4728-bce0-0864dd72bb92 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.525869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:10:00.530985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d8ee-9bf1-4212-bc97-6142c8c11f03 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.531442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d8ee-9bf1-4212-bc97-6142c8c11f03 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.531555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d8ee-9bf1-4212-bc97-6142c8c11f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.550789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-40d6d8ee-9bf1-4212-bc97-6142c8c11f03 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:10:00.551978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40d6d8ee-9bf1-4212-bc97-6142c8c11f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:00.559781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:10:00.853093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab829e3-b0a2-4728-bce0-0864dd72bb92 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:10:00.863968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab829e3-b0a2-4728-bce0-0864dd72bb92 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:10:00.867575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:10:00.868198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.868481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.868756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.877742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:10:00.879171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b41bc-e676-4c0b-a49c-9cd2d9be85a7 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:10:00.888348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 773/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:04.904984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:04.906120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:04.906373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:04.907737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:10:04.913090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405179-1f35-4300-a5f4-3cff02ce8ba7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:04.913564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405179-1f35-4300-a5f4-3cff02ce8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:04.913677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0405179-1f35-4300-a5f4-3cff02ce8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:04.921291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=81 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:04.934015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c0405179-1f35-4300-a5f4-3cff02ce8ba7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:10:04.935218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0405179-1f35-4300-a5f4-3cff02ce8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:04.943810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:10:05.246054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:10:05.247734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:05.313280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:05.327904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f121b-a605-4e03-b6cc-3348091ff915 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:10:05.331506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:10:05.332122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:05.332404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:05.332681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:05.341836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:10:05.343888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1832f-14f9-4dd4-a126-fc4173edfd4f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:10:05.353150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 762/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:07.503314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:07.503879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:07.503879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:07.505112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:10:07.510509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448d8e-64f4-4f47-a3a8-a137f577fa03 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:07.511023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448d8e-64f4-4f47-a3a8-a137f577fa03 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:07.511331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448d8e-64f4-4f47-a3a8-a137f577fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:07.531619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9a448d8e-64f4-4f47-a3a8-a137f577fa03 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:10:07.532814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9a448d8e-64f4-4f47-a3a8-a137f577fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:07.540702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:10:07.844605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:10:07.846281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:07.859811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293329dd-4bb5-4e85-9508-4cfefa4c83c6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:10:07.863355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:10:07.863938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:07.864215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:07.864485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:07.873120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:10:07.875478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38cad-1fee-4c28-90a4-5038dc26c991 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:10:07.884518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 776/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:17.526330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:17.880514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:38.167538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.168681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.168681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.194252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.195844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.209557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 764/1540] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.219930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.220509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.220509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.255014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.256242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.271513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 777/1541] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.276863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.291225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020ee2-4bcc-4d9a-abc6-274ebf4e2a17 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.300675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.301817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.302355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.302842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.303709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:38.304319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.306602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.325800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 765/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:38.336654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.348087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6086-c93a-4753-9659-dcb2e6014074 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.357436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.358018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.358303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.358581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.359233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.361166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.418584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 778/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.423636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.439973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe02fe-d7da-4eb3-bd87-83956e444949 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.526370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.527596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.528395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.528984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.529968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.532341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.563122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 766/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.567885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.585730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405469-b557-4a31-a0f6-50708d3d7464 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.597045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.597900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.598196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.598477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.599143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.601054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a28620-c1d5-4b06-9260-908e0b1feb4f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.619959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 779/1545] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:38.625472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.638768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5388bf-42ae-4aad-afb8-50be93efd6d2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.647647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.648233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431531-50f5-4963-bd7b-f4c649148061 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.648537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431531-50f5-4963-bd7b-f4c649148061 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.648820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431531-50f5-4963-bd7b-f4c649148061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.649450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.649980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.650458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.651332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.654266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.675918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 767/1546] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:38.680350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.688013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-04431531-50f5-4963-bd7b-f4c649148061 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.688013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-04431531-50f5-4963-bd7b-f4c649148061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.695620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6d98e-d2c8-4ecb-adb8-144b676f48b7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.701008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 780/1547] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.705191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.706258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.706783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.707286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] PATH_INFO: `/v3/projects/f4545265a4da4494a9bba43ff4e3d82b/users/c68a9247d24247c5ab68e929625bac4e/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.709611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e8ce-a1b6-4803-a6b5-a68a463c333a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.709917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e8ce-a1b6-4803-a6b5-a68a463c333a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.710219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e8ce-a1b6-4803-a6b5-a68a463c333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.732232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4545265a4da4494a9bba43ff4e3d82b, user_id=c68a9247d24247c5ab68e929625bac4e, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.733895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:38.733895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:11:38.733895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:11:38.736472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88005-ef3d-4fcc-af4b-4de3a1559b28 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.747387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f342e8ce-a1b6-4803-a6b5-a68a463c333a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.748689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f342e8ce-a1b6-4803-a6b5-a68a463c333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.761895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 768/1548] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:38 2022] PUT /identity/v3/projects/f4545265a4da4494a9bba43ff4e3d82b/users/c68a9247d24247c5ab68e929625bac4e/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:38.767540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9ee-4916-4cf2-83d1-1523bf1ec7f9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.768111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9ee-4916-4cf2-83d1-1523bf1ec7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.768696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea9ee-4916-4cf2-83d1-1523bf1ec7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.804763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-db3ea9ee-4916-4cf2-83d1-1523bf1ec7f9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.807461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-db3ea9ee-4916-4cf2-83d1-1523bf1ec7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.863532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 781/1549] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.864918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.865212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.865491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.898778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.899940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.920350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 782/1550] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.921083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.936587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230fa92-8c24-458c-ba50-6de0d9c1272a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.936875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 769/1551] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:11:38.938382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727bd2-a706-4665-b7d5-9d5103c0ebe9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.938767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727bd2-a706-4665-b7d5-9d5103c0ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.939148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727bd2-a706-4665-b7d5-9d5103c0ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.950274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.950916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.951185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.951459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.952191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:38.952435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.953528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:38.953528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:11:38.953528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:11:38.954798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a073afc-3c95-427b-b582-c79ad084ed33 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.969148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 783/1552] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:38.970465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.970756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.971040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.983911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1727bd2-a706-4665-b7d5-9d5103c0ebe9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.986308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1727bd2-a706-4665-b7d5-9d5103c0ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.994748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 770/1553] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.996076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8ca8-6c41-411e-861d-97e34a0d290a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.996539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8ca8-6c41-411e-861d-97e34a0d290a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.996906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8ca8-6c41-411e-861d-97e34a0d290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.002386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.004624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.017381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 784/1554] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.018201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.019736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.020233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cc1b8ca8-6c41-411e-861d-97e34a0d290a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.021418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc1b8ca8-6c41-411e-861d-97e34a0d290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.030246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 771/1555] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.031449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.031736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.032171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.056595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.058336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.067254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 772/1556] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.068014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.079112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec2fd-5c34-48e6-88f3-4a2733a48957 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.083620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb8e2f-98c7-4b25-b2fe-fe17b8ec3351 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.084421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.085198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.085481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.085797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.086427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.087797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:39.087797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:11:39.087797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:11:39.089684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.090046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa59d6-4299-4bbf-9bee-9bd4db649fdc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.091095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.095056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.095056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.105326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.106958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e1d8-56d7-47a9-830b-9fc10de6b559 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.113039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.116809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 785/1557] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:39.118247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83c4-c888-4f33-b878-3b89be6478fb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.118796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83c4-c888-4f33-b878-3b89be6478fb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.118796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da83c4-c888-4f33-b878-3b89be6478fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.133629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 773/1558] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 401 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.134861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.135159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.135490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.140198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-85da83c4-c888-4f33-b878-3b89be6478fb None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.141701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-85da83c4-c888-4f33-b878-3b89be6478fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.160969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.161469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.162437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.218025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 786/1559] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.219390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa582d0-40b8-4b79-811b-bb4cce3f2d2a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.219682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa582d0-40b8-4b79-811b-bb4cce3f2d2a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.219955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa582d0-40b8-4b79-811b-bb4cce3f2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.240241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 774/1560] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.241749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.245170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1fa582d0-40b8-4b79-811b-bb4cce3f2d2a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.247274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1fa582d0-40b8-4b79-811b-bb4cce3f2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.255212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600cfba-9e07-4029-95b7-e1eb9d5f1e9f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.256419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 787/1561] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.257495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.257808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.258076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.269822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.270726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.271017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.271294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.272427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.272427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.273963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4f20-0eef-421f-95a8-1a0580476a75 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.282843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.284175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.292113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 775/1562] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.293301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.293649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.293939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.295475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 788/1563] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.296560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.307467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac916f-0196-475f-bb28-45c47d3a0294 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.313462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.314109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.316841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.316841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.316841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.318015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:39.318015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:11:39.318015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:11:39.319302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604d852-2e28-42fc-a97d-5dc110fb8dc3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.335902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.337343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.346593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 789/1564] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/users => generated 301 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.347964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f04-114f-4df4-b4ca-52d2c8fa72d6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.348310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f04-114f-4df4-b4ca-52d2c8fa72d6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.348590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f04-114f-4df4-b4ca-52d2c8fa72d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.353789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 776/1565] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.353789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.365128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ea45-301d-40b2-9f1c-9a0959948f94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.369703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.370327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.370596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.370886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.372199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.372607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.373230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6eeb4f04-114f-4df4-b4ca-52d2c8fa72d6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.374189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.374658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6eeb4f04-114f-4df4-b4ca-52d2c8fa72d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.384125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 790/1566] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.385758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.386075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.386448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.389556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 777/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.389556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.405403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceaea9-c596-4e30-a48b-45e5aaf9c8fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.411836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.412080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.412403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.412683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.413368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.415353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.415490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.416636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.426057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 791/1568] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.430168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.442653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11984d-3dfe-4c67-b70e-bccb0975486a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.450262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.451069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.451671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.451882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 778/1569] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.452582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.453934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.454968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.455359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.457409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.481599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 792/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.484074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.498702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012dd40-092e-4424-b946-8691739fe32d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.545177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9545f-b5c4-4ac4-937e-99f5c323a4be admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.549910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.550527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.550808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.551082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.551739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.553339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.566956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 779/1571] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:39.568225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.578322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625decf-442d-4f90-ba9e-bf689404bb07 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.578829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.580119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.580119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.580337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.580910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.581213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.582939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.586329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.587737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.588105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.588837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.589620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.591235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.593152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.597498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 793/1572] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.598180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.610352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ce22c-42fa-42dd-824d-a27264e7be4e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.615572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.616470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.616603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 780/1573] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.617204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.623702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.623947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.624772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.626891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.628066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c1a5-0aa7-47ca-a6a0-c7bb694d8242 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.632867 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.633470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.633788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.634064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.634712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:39.635016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.636764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.653159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 781/1574] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:39.654611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.663689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 794/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.664643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.665638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba292-c401-4d89-95c0-50032fdd10cb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.672652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.716013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.742245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35b515-92b1-4c30-8354-85c9dc2eb0ef admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.743715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.744369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.744706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.744985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.745640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.747268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.748206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.748343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.748449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.748449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.749158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.751206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.773147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 782/1576] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.773147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.787372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f86eb-a1bd-4715-a2eb-7d8a213dbf65 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.789226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 795/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.790694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.797643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.798821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.799128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.799410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.800067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.801716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.814404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 783/1578] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:39.815530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.828019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781a121-d3e3-4ab2-9ccf-38fc600492a8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.884867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903cf2-9e31-4039-948f-f86294c181a3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.891095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.891956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.892328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.892671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.893450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.895513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.941691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 796/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:39.943070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.944170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.944797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.945075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.945343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.946111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.948281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.006624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 784/1580] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.007497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.022961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbe01-36a6-4247-a286-c438b611f8a7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.091101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:40.095118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17746e-4fd2-4d30-88cc-fc56da5df896 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.110367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.111019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.111305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.111584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.112224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.114214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.114638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.115340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.115694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.116027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.117863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.120369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.145060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 785/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.149767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.156958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:40.162998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 797/1582] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.164017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.168992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de3aca-60d9-40ff-94ce-c0c84c6c48ee admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.238619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.239256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.239677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.239966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.240744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.242532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.246217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0173d77-9b55-44c6-8688-a7b2e62bc05b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.252664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.253443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.253966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.254339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.255134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.257588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 786/1583] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.257748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.258748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.269892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a2fe1-8e4f-4408-9b25-8f1021c0e513 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.275914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.276593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.276881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.277159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] PATH_INFO: `/v3/projects/b0e0d68a631d4a0e915c6f9ec93c093a/users/d78b74c551ab49fdb1ddd531017e9e2c/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.305605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e0d68a631d4a0e915c6f9ec93c093a, user_id=d78b74c551ab49fdb1ddd531017e9e2c, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.307714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 798/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.310380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.313620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.329428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cae0a-bd35-4f60-b400-fd9225e5eb9e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.331952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 787/1585] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:40 2022] PUT /identity/v3/projects/b0e0d68a631d4a0e915c6f9ec93c093a/users/d78b74c551ab49fdb1ddd531017e9e2c/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:40.333100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.416432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.417065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.417398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.419141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.419801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.422516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.425372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddfea1-0fdd-45e8-956a-abc55749a029 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.431414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.432171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.432691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.433047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.433946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.436135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.453325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 799/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.454556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.472151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 788/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.472151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.475068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0cc8-8053-4029-ad7e-cfee30bbef92 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.483292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.483512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d297b9e-a35d-4a6d-a0c1-e056cec8afe5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.483922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.484207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.484484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.485393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.487854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.490569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.491327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.491613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.491883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.492529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.495669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.508612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 800/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.509665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.523204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40c04a-f945-4584-b71c-c0e6ebc8b9c4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.523367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 789/1589] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/users => generated 282 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:40.524910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.534221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.534853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.535138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.535541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.536138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.537796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550832f4-9ab2-4325-bb35-4de9592cca68 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.539607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb0c-c14d-4394-8438-8476bb0558b5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.545916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.546812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.547166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.547508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.548276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.549958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.559454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 801/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.561958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.563102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.563230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 790/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.563771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.564237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.578784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc72-8a07-48d1-8578-bd0e02a5fbd2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.585104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.585756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.586116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.586602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.587405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.589369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.593732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:40.595134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:40.608459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 791/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.609406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.618696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 802/1593] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:40.619927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.621041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798be7d6-39b2-4b19-a778-1ff2725617f7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.628936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.630036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.630601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.631111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.632126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.636578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680789c-dbdb-40b4-8de5-61687ce770fa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.637536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.643638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.644264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.644548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.644823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.645477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.647788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.656672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 792/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.658182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.666568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 803/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.667486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.671724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f204b51-e34f-4d40-94e2-05d857531d50 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.686250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.687145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.687145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.687419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.690174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.692003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.699643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b97ac-d5a9-4569-812c-7a46ecbfdf65 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.706334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.707178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.707583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.708374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] PATH_INFO: `/v3/projects/f17fdf0bb4b54ad6a5eb185a777cec41/users/0efe8a52f2404587b05032b689efcdb7/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.714848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 793/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.719706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.725712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:40.732591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3849f-da9d-4a38-b6a0-c04ffc182cf7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.732911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17fdf0bb4b54ad6a5eb185a777cec41, user_id=0efe8a52f2404587b05032b689efcdb7, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.736549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.739110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.740087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.740469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.741131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:40.741256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.742740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.745843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.754842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 804/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:40 2022] PUT /identity/v3/projects/f17fdf0bb4b54ad6a5eb185a777cec41/users/0efe8a52f2404587b05032b689efcdb7/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:40.765818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 794/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.765818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.766103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.772891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c5608-56ec-4b96-98e7-fbaff524ea5d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.831751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37f89-779e-46d0-9f71-c5c07d888ddf admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.837363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.838958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.839361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.840530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.859770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.860410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.860711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.861018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.862580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.864149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.934606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 795/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.934606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.934606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e9a1-87af-4d37-be96-88b062191024 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.934606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.962515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.962515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.962515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.962515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.962515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.963277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.963277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.964138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 796/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:40.964138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.968880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 805/1601] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:40.969835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.979440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724c39-f00a-44ba-b7fa-183087f5570c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.982910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa70c-dd5c-428c-af69-f33a3fef796e service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.985229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.986160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.986473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.986820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] PATH_INFO: `/v3/projects/d47c089a8a8d4b61a18cd6644a5107df/users/2a386fe686ac441d99fa747ff0452212/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.994897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.995690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.996766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.997141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.998633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.001031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.007311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47c089a8a8d4b61a18cd6644a5107df, user_id=2a386fe686ac441d99fa747ff0452212, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.010494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a7d83-2730-415b-81b3-0e8a9b5019f4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.024015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 806/1602] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:41.025268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.043825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 797/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:40 2022] PUT /identity/v3/projects/d47c089a8a8d4b61a18cd6644a5107df/users/2a386fe686ac441d99fa747ff0452212/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:41.047740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.049844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.051005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.053994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660443-fae1-426d-8385-60d13a4a6572 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.120226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] MFA Rules not processed for user `0efe8a52f2404587b05032b689efcdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.127697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.159299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.159896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.160282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.160881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] PATH_INFO: `/v3/projects/84b3074b4ece46c8a3cc7b6c27202ee8/users/7702797ce48b47d2a42f5fb45ed18c43/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.179868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b3074b4ece46c8a3cc7b6c27202ee8, user_id=7702797ce48b47d2a42f5fb45ed18c43, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.182598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.204401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 807/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:41 2022] PUT /identity/v3/projects/84b3074b4ece46c8a3cc7b6c27202ee8/users/7702797ce48b47d2a42f5fb45ed18c43/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:41.205398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.225237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 798/1605] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.226472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.235038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:41.248140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6c87-dfa2-4232-b4b0-39fd79c6ac7a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.311414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8c77a-397d-4193-a41a-cb9c61b84e34 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.314143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:41.321209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.322943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.323451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.323884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] PATH_INFO: `/v3/projects/2d68175b72c4478db1804c25898e4858/users/47de15dc16c54bcfa3ebf300fc590cff/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.337118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde85800-2242-4071-b534-338120953e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.338685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85800-2242-4071-b534-338120953e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.339066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85800-2242-4071-b534-338120953e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.339543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85800-2242-4071-b534-338120953e37 admin admin] PATH_INFO: `/v3/projects/4e97fb6362894ecaa285678f0e42dfb8/users/67bb6da95fc446dcb4799b4f17bc882a/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.348028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d68175b72c4478db1804c25898e4858, user_id=47de15dc16c54bcfa3ebf300fc590cff, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.351915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.363533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde85800-2242-4071-b534-338120953e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e97fb6362894ecaa285678f0e42dfb8, user_id=67bb6da95fc446dcb4799b4f17bc882a, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.366658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde85800-2242-4071-b534-338120953e37 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.378530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 808/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:41 2022] PUT /identity/v3/projects/2d68175b72c4478db1804c25898e4858/users/47de15dc16c54bcfa3ebf300fc590cff/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:41.383919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.390838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 799/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:41 2022] PUT /identity/v3/projects/4e97fb6362894ecaa285678f0e42dfb8/users/67bb6da95fc446dcb4799b4f17bc882a/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:41.403045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ee60-080f-41ce-a98c-8632bd316af7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.403362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ee60-080f-41ce-a98c-8632bd316af7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.403605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ee60-080f-41ce-a98c-8632bd316af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.436440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9ce3ee60-080f-41ce-a98c-8632bd316af7 None None] MFA Rules not processed for user `2a386fe686ac441d99fa747ff0452212`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.437808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ce3ee60-080f-41ce-a98c-8632bd316af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.498395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bdf93-a4b2-418b-95a8-a0d93996eb10 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.575467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 800/1608] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.578371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f6f1-917d-4d6d-96e3-a5f51cc4cc09 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.578671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f6f1-917d-4d6d-96e3-a5f51cc4cc09 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.578954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f6f1-917d-4d6d-96e3-a5f51cc4cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.579716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.580622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.581083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.581607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] PATH_INFO: `/v3/projects/5a25fac56eb6426aba8a1fc3cff626c5/users/883f8d7bbbdc4a2facb769052a4d4795/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.605765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a25fac56eb6426aba8a1fc3cff626c5, user_id=883f8d7bbbdc4a2facb769052a4d4795, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.610135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.630541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 809/1609] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:41 2022] PUT /identity/v3/projects/5a25fac56eb6426aba8a1fc3cff626c5/users/883f8d7bbbdc4a2facb769052a4d4795/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:41.631888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.658327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c98f6f1-917d-4d6d-96e3-a5f51cc4cc09 None None] MFA Rules not processed for user `7702797ce48b47d2a42f5fb45ed18c43`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.658327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c98f6f1-917d-4d6d-96e3-a5f51cc4cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.676529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:41.720701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2e98d-b3de-4a44-8c76-5cb2069717ac admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.725828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.726794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.727145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.727489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.757592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 801/1610] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.763795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069dd51-96b0-43e2-b301-42adaefd03a4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.764518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069dd51-96b0-43e2-b301-42adaefd03a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.765420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069dd51-96b0-43e2-b301-42adaefd03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.802921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9069dd51-96b0-43e2-b301-42adaefd03a4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.804531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9069dd51-96b0-43e2-b301-42adaefd03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.848612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.851221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b5610-a206-4202-9566-66aee1629814 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.862410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 810/1611] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:41.863880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:41.864867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6907c7c-cc50-4ce3-85f2-8776b35526f0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.865168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6907c7c-cc50-4ce3-85f2-8776b35526f0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.865460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6907c7c-cc50-4ce3-85f2-8776b35526f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.891139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b6907c7c-cc50-4ce3-85f2-8776b35526f0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.892411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b6907c7c-cc50-4ce3-85f2-8776b35526f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.915679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 802/1612] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.917015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37713-47a4-492f-b93c-59d8fbf39de9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.917309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37713-47a4-492f-b93c-59d8fbf39de9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.917615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37713-47a4-492f-b93c-59d8fbf39de9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.927893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 803/1613] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:11:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:41.931078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.931379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.931658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.989401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] MFA Rules not processed for user `883f8d7bbbdc4a2facb769052a4d4795`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.990677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:42.098559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 811/1614] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:42.098559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd476-5b6d-41b9-985f-fe471440b641 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.098559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd476-5b6d-41b9-985f-fe471440b641 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.098559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd476-5b6d-41b9-985f-fe471440b641 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.110794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 812/1615] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:11:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:42.120943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.121591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.122248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.173543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 804/1616] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:42.173543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.248831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:42.250042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:42.317083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a28f2-d1d9-446e-8d88-99f9e34083ab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:42.327004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:42.329360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.329719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.330002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.352459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:42.353766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f255e-17ed-47e8-b5af-a8a98c3f8c75 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:42.379623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 805/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:42.380766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.381053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.382414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.416863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 813/1618] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:42.419061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.431289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:42.431562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:42.435233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:42.440157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c211-6a57-4b80-96ed-b096c5732dcf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:42.448413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:42.451791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.451969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.452191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.470256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 806/1619] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:42.471817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.492309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:42.497154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:42.509015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db3e2-ed3e-4380-b9ac-2e4344f94502 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:42.520804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:42.521419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.521709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.521984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.523096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:42.524593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:42.527016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 814/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:42.527332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.557123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419005f-415b-4b7b-8ea9-f690bb5961e5 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:42.575059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:42.576961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.577763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.578217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.580347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 807/1621] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:42.584760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.703595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:42.720719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:42.722711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa2d04-cb7c-4b9a-b138-9eac15c734d3 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:42.737759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 815/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:42.739183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.739476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.739749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.776914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694809-0fdb-44ee-95c7-3a6a65aa0541 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:42.790317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] MFA Rules not processed for user `d78b74c551ab49fdb1ddd531017e9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:42.797195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:42.798190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:42.799178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:42.799534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:42.799906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:42.956100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:42.958080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:42.981943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 816/1623] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:42.982677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 808/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:42.984372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:42.984491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.174818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1dabe-8daf-4d7e-8f10-89f5e2f44689 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.193651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.194404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.194911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.195423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.196183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.198911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.221837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e98ad-2194-4c3b-ad51-8b97d847e211 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.235803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.238139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.238434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.239352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.241075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.248546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.291156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 817/1625] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:43.292139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.331804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8acd1-03c7-47de-b414-e7c217e4d193 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.351773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.352549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.352834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.353154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.353845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.356914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93e89-f12b-44a0-845c-f10b8d229b08 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.360356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:43.368336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 809/1626] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:42 2022] POST /identity/v3/projects => generated 403 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:11:43.369817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.395688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 818/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:43.395688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d74c4-350f-4372-997c-e654f2dbf83b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.396380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d74c4-350f-4372-997c-e654f2dbf83b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.396672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d74c4-350f-4372-997c-e654f2dbf83b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.399309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 819/1628] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 29 02:11:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:43.400158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d74c4-350f-4372-997c-e654f2dbf83b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.500176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796f97-1a8c-436e-be82-a8dc37fc0b1c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.509220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d74c4-350f-4372-997c-e654f2dbf83b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.513428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.514282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.514719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.515314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.516106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.516227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.517098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.517754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.518089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] PATH_INFO: `/v3/projects/25949c4efc5441fea383641aab530e51/users/cba86e572cff479fa0372e72874f5bc7/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.519605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495fbd-ba30-4b68-bcdf-f9cb70510815 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.544504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25949c4efc5441fea383641aab530e51, user_id=cba86e572cff479fa0372e72874f5bc7, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.549735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.563282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:43.570997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 810/1629] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:43 2022] POST /identity/v3/users => generated 308 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:11:43.574492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.575872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.576869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.582095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 820/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:43 2022] PUT /identity/v3/projects/25949c4efc5441fea383641aab530e51/users/cba86e572cff479fa0372e72874f5bc7/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:43.583333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.638643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:43.643297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:43.754484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8d7fc-1838-4543-84e4-51456391a92d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.774579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.776311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.777234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.777922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.779467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.785814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.807891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 811/1631] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:43.817056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 821/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:43.820217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.820731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.850565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b9fd-019d-4774-be02-ce95888164e3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.852038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1db6cb-ede5-4576-889e-1a395140dd52 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:43.860224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.861080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.861365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.861700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.862372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.866203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.867897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:43.868975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:43.870211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:43.870739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] PATH_INFO: `/v3/projects/8f69aedc8d034087b273167104a4bc5a/users/24bed29b715b4ba7b63a6c766464690e/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:43.897864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 812/1633] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:43.907027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.913413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f69aedc8d034087b273167104a4bc5a, user_id=24bed29b715b4ba7b63a6c766464690e, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:43.919973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:43.947057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 822/1634] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:43 2022] PUT /identity/v3/projects/8f69aedc8d034087b273167104a4bc5a/users/24bed29b715b4ba7b63a6c766464690e/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:43.950842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:44.022315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f373161-da86-47f7-9713-5171265681bd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.032143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:44.049720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2fd8-6706-4f9c-8845-d78546b46210 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.056202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.057022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.057452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.057839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] PATH_INFO: `/v3/projects/25949c4efc5441fea383641aab530e51/users/cba86e572cff479fa0372e72874f5bc7/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.061255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25949c4efc5441fea383641aab530e51, user_id=cba86e572cff479fa0372e72874f5bc7, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.065379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968da6d-4c05-4540-8f72-e5478f4a3011 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 823/1635] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:43 2022] PUT /identity/v3/projects/25949c4efc5441fea383641aab530e51/users/cba86e572cff479fa0372e72874f5bc7/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549c70f-cd6c-4304-979b-e2edb456e305 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549c70f-cd6c-4304-979b-e2edb456e305 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549c70f-cd6c-4304-979b-e2edb456e305 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 824/1636] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 29 02:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:44.090459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549c70f-cd6c-4304-979b-e2edb456e305 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:44.117294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.117948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.118237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.119356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.179257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549c70f-cd6c-4304-979b-e2edb456e305 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.187782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.188669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.189180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.189675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.191320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.193238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddc015-732f-457c-9d2d-5622fbd4a5aa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.207483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 825/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:44.208986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.209370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.210514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.255437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] MFA Rules not processed for user `cba86e572cff479fa0372e72874f5bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:44.256964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:44.279960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:44.322753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.324528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4ec76-e8cc-4ab0-b5f1-82df82879142 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.378066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 813/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:44.378907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.379541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.379541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.429193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:44.430864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:44.477868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 826/1639] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:44.478875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:44.498669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3273f5-da13-429c-aa9d-9de22ee79c6b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.507282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.508127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.508511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.508991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] PATH_INFO: `/v3/projects/8f69aedc8d034087b273167104a4bc5a/users/24bed29b715b4ba7b63a6c766464690e/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.514003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f69aedc8d034087b273167104a4bc5a, user_id=24bed29b715b4ba7b63a6c766464690e, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.519079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.544003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 827/1640] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:44 2022] PUT /identity/v3/projects/8f69aedc8d034087b273167104a4bc5a/users/24bed29b715b4ba7b63a6c766464690e/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:44.545278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:44.606600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 814/1641] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:44.673197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d989f58-73e0-4263-8ad0-b6b21acd81bc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.681343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.682941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.683998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.684527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.700277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:44.839181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.841407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923eef0-3738-417f-a1a1-02c34b4e9ca1 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.865912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 828/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:44.866181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:45.070439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8e67d-8f1e-4c3d-8a15-a65266acacca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:45.081147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:45.083100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:45.083585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:45.084963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:45.264276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:45.265832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:45.283750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 815/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:11:46.894575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d3b4a-37ec-4df8-84f6-3d6b6de8f361 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:46.895728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d3b4a-37ec-4df8-84f6-3d6b6de8f361 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:46.896187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d3b4a-37ec-4df8-84f6-3d6b6de8f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:46.976144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bc5d3b4a-37ec-4df8-84f6-3d6b6de8f361 None None] MFA Rules not processed for user `24bed29b715b4ba7b63a6c766464690e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:46.977463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc5d3b4a-37ec-4df8-84f6-3d6b6de8f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:47.221154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 829/1644] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:47.405695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:47.435301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:47.542410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b936-36ba-4eb0-a0bb-6e297f7e3589 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:47.571036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:47.571927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:47.577477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:47.578089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] PATH_INFO: `/v3/users/883f8d7bbbdc4a2facb769052a4d4795` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:47.579611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883f8d7bbbdc4a2facb769052a4d4795)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:47.580823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:47.580823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 29 02:11:47.580823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: Sep 29 02:11:47.582076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:47.722226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883f8d7bbbdc4a2facb769052a4d4795'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.750804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883f8d7bbbdc4a2facb769052a4d4795'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.753212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883f8d7bbbdc4a2facb769052a4d4795'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.754416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883f8d7bbbdc4a2facb769052a4d4795'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.818107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883f8d7bbbdc4a2facb769052a4d4795'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.918816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 816/1645] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:47 2022] DELETE /identity/v3/users/883f8d7bbbdc4a2facb769052a4d4795 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:47.923243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:47.923776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:47.924139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.014432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:48.019130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.043488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.045255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.201564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef21d4-7778-4292-aef6-3b59d3dc9ff1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.212465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.214235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.214811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.216001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] PATH_INFO: `/v3/users/2a386fe686ac441d99fa747ff0452212` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.219799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a386fe686ac441d99fa747ff0452212)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.225069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.239987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 830/1646] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:48.291976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:48.330170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a386fe686ac441d99fa747ff0452212'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:48.351868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a386fe686ac441d99fa747ff0452212'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:48.356818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a386fe686ac441d99fa747ff0452212'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:48.358251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a386fe686ac441d99fa747ff0452212'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:48.391766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.393456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.394679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3458f4-65fc-421b-a7b8-16443b089026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a386fe686ac441d99fa747ff0452212'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:48.441631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 817/1647] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:48 2022] DELETE /identity/v3/users/2a386fe686ac441d99fa747ff0452212 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:48.453616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.454142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.454568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.484855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:48.504153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:48.507541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.559653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c568b-31a4-45f6-a633-ebc71755e1b5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.658006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 818/1648] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:48.676518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.678137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.735134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.735678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.735971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.736245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.738676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.758367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.759995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.800812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 831/1649] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:11:48.817725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7274eca-1c2b-47b3-95e0-daecd2312c26 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.822213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.822852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.823137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.823460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.835117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.837122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592e28-5b40-4523-a8a8-6d711d4d5d0a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.852182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 819/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:11:49.698238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.701068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:49.714132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d80d2-f557-49db-b96e-e2da4e09d31c service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:49.720867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:49.721759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.722194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.722598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] PATH_INFO: `/v3/projects/d47c089a8a8d4b61a18cd6644a5107df` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.723925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47c089a8a8d4b61a18cd6644a5107df)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:49.725136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:49.725136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: warnings.warn(msg) Sep 29 02:11:49.725136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: Sep 29 02:11:49.726717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.795151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47c089a8a8d4b61a18cd6644a5107df', 'request_id': 'req-6fd71a18-12bd-43d7-a2b1-02845f24eba6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.812040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47c089a8a8d4b61a18cd6644a5107df', 'request_id': 'req-6fd71a18-12bd-43d7-a2b1-02845f24eba6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.838895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47c089a8a8d4b61a18cd6644a5107df', 'request_id': 'req-6fd71a18-12bd-43d7-a2b1-02845f24eba6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.858339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947bba-ea07-44a0-85f6-0f7c189434b4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.858801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947bba-ea07-44a0-85f6-0f7c189434b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.862228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947bba-ea07-44a0-85f6-0f7c189434b4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.864785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 820/1651] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:11:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:11:49.884743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] The token cache is being invalidate because project d47c089a8a8d4b61a18cd6644a5107df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:49.885040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.885970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6fd71a18-12bd-43d7-a2b1-02845f24eba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.890811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 832/1652] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:49 2022] DELETE /identity/v3/projects/d47c089a8a8d4b61a18cd6644a5107df => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:49.896082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b783-5be4-43e0-bc36-f68dcb6a126b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.896575 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b783-5be4-43e0-bc36-f68dcb6a126b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.897130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b783-5be4-43e0-bc36-f68dcb6a126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.940013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7ef3b783-5be4-43e0-bc36-f68dcb6a126b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:49.945877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ef3b783-5be4-43e0-bc36-f68dcb6a126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.027063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.027370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.027652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.076696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:50.110465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:50.114999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.126373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 821/1653] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:50.134508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.134809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.135234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.204306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:50.214748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.246584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 822/1654] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:50.248207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.260749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247db74-ba49-4f8f-a08e-767d881ec978 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.270661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.272051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.273782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.274514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.277598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:50.278150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.281169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.319198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 823/1655] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:50.321411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.323426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 833/1656] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:50.338196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f38bc-8742-41df-b9f3-eefe5ec49c57 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.355647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.355647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.355647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.355647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.356493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.356493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.405386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 824/1657] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:50.407132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.424992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1770f7-67c1-43b5-8c95-14ef52322b5e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.440330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.442267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.464990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:50.644710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.646506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.647439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.647883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.648557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.668522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.680744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafb15-7acb-49ad-b383-c278cc6d046b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.694344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.698485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.699079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.700056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.731869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 834/1658] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:50.734004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.740703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.744434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.759009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.795208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e261c-7971-4079-9bc4-f840e0bf3768 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.796505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 825/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:50.797453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.810816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.811560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.811753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.812085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] PATH_INFO: `/v3/users/7702797ce48b47d2a42f5fb45ed18c43` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.813601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7702797ce48b47d2a42f5fb45ed18c43)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.817979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.836666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96613057-77bf-45e2-a3b1-2f9b94be6154 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.858546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.859557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.859721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.860150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.860948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.864424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.884776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 826/1660] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:50.885999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.900292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f446-7b0c-4824-aaec-ed694871ef52 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.912073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.912751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.913030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.913306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.913984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.921623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.933721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7702797ce48b47d2a42f5fb45ed18c43'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.945787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7702797ce48b47d2a42f5fb45ed18c43'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.946529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7702797ce48b47d2a42f5fb45ed18c43'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.958344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7702797ce48b47d2a42f5fb45ed18c43'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.976676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 827/1661] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:50.978133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.982752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.983945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f499f681-191a-4741-800e-8c95bb60ca0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7702797ce48b47d2a42f5fb45ed18c43'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.002713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 835/1662] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:50 2022] DELETE /identity/v3/users/7702797ce48b47d2a42f5fb45ed18c43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:51.008842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45340182-54de-4eb0-9eaa-25179be84c1b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.009137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45340182-54de-4eb0-9eaa-25179be84c1b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.009419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45340182-54de-4eb0-9eaa-25179be84c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.030826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8efa8-9d08-49a1-a911-54f075c045f1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.062954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-45340182-54de-4eb0-9eaa-25179be84c1b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:51.066528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-45340182-54de-4eb0-9eaa-25179be84c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.196063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359393d-100e-4491-a753-98c121083525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.196984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359393d-100e-4491-a753-98c121083525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.197158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359393d-100e-4491-a753-98c121083525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.197434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359393d-100e-4491-a753-98c121083525 admin admin] PATH_INFO: `/v3/projects/82b0cb1a71824ee9ba992441a9941167/users/0d1813f182004444ae4447e1c17e852b/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.260049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359393d-100e-4491-a753-98c121083525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b0cb1a71824ee9ba992441a9941167, user_id=0d1813f182004444ae4447e1c17e852b, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.266704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359393d-100e-4491-a753-98c121083525 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.312694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 836/1664] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:51.314574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.315452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 828/1664] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:50 2022] PUT /identity/v3/projects/82b0cb1a71824ee9ba992441a9941167/users/0d1813f182004444ae4447e1c17e852b/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:51.316682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.317086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.318009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.318298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.318623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.327644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:51.376176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] MFA Rules not processed for user `0d1813f182004444ae4447e1c17e852b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:51.379495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.383606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:51.431591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] MFA Rules not processed for user `c68a9247d24247c5ab68e929625bac4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:51.437267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.570497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 829/1665] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:51.572076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.579683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.666716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 837/1666] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:51.668380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.672342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.749471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e4868-892f-4bb0-aa30-a2a3ca3140d4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.758357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.758998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.759279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.759548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.843995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b196d-6a0c-496d-b0fd-0dfa79617e08 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.856073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.857268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.857387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.857724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] PATH_INFO: `/v3/projects/5a25fac56eb6426aba8a1fc3cff626c5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.860897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a25fac56eb6426aba8a1fc3cff626c5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.862967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.897958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.900139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.913085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 830/1667] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:51.914340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.915961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.957257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a25fac56eb6426aba8a1fc3cff626c5', 'request_id': 'req-ac07a807-4939-4e8b-9301-7e99ec8a49e4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.964972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a25fac56eb6426aba8a1fc3cff626c5', 'request_id': 'req-ac07a807-4939-4e8b-9301-7e99ec8a49e4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.972705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a25fac56eb6426aba8a1fc3cff626c5', 'request_id': 'req-ac07a807-4939-4e8b-9301-7e99ec8a49e4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.990836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] The token cache is being invalidate because project 5a25fac56eb6426aba8a1fc3cff626c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:51.991214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.991961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.993776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 838/1668] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:51 2022] DELETE /identity/v3/projects/5a25fac56eb6426aba8a1fc3cff626c5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:51.997094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.999085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.006818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.061732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.072434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42181871-ae97-4c62-8963-7104609ab0d9 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.164133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a807-4939-4e8b-9301-7e99ec8a49e4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.173049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.174050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.174758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.174758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.185898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.235970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.238224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.238517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.239079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.247002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.366478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.368441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:52.391629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 839/1669] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:52.394143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:52.400265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.413712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.415701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:52.441123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 831/1670] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:52.559504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bf089-61c5-4182-a7b7-e6d1a889e090 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.574050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.574877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.575337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.575619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] PATH_INFO: `/v3/users/cba86e572cff479fa0372e72874f5bc7` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.580436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba86e572cff479fa0372e72874f5bc7)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.585148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:52.695195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba86e572cff479fa0372e72874f5bc7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.707544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba86e572cff479fa0372e72874f5bc7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.707544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba86e572cff479fa0372e72874f5bc7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.733107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba86e572cff479fa0372e72874f5bc7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.746751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.766269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4c7a43a-c023-4d5f-be9a-7ede15c33dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba86e572cff479fa0372e72874f5bc7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.789749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 840/1671] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:52 2022] DELETE /identity/v3/users/cba86e572cff479fa0372e72874f5bc7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:53.190905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:53.192530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.230987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646af09-139c-4f59-8f29-afbb3c75f509 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:53.449136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.450707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.450707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.450939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] PATH_INFO: `/v3/users/0d1813f182004444ae4447e1c17e852b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.454703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1813f182004444ae4447e1c17e852b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.456971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.503699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:53.568412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1813f182004444ae4447e1c17e852b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.593106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1813f182004444ae4447e1c17e852b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.594388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1813f182004444ae4447e1c17e852b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.596769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1813f182004444ae4447e1c17e852b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.614133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1813f182004444ae4447e1c17e852b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.662339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 832/1672] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:53 2022] DELETE /identity/v3/users/0d1813f182004444ae4447e1c17e852b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:53.669157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.669754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.670156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.710905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:53.713973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.752664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:53.754596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.867599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 841/1673] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:53.884718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:53.888176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.900570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaaade-f5c3-4eab-b333-51f8b203f0a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:53.912062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683530-8098-4ed2-9485-1c3c7e8a8572 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:53.919873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.920553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.920839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.921119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] PATH_INFO: `/v3/projects/84b3074b4ece46c8a3cc7b6c27202ee8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.922379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b3074b4ece46c8a3cc7b6c27202ee8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.924340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.930769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.931772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.932108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.932410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] PATH_INFO: `/v3/users/d78b74c551ab49fdb1ddd531017e9e2c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.935625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78b74c551ab49fdb1ddd531017e9e2c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.937892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.028865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b3074b4ece46c8a3cc7b6c27202ee8', 'request_id': 'req-46febb68-ef97-448e-957f-99e4e14accb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.041968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b3074b4ece46c8a3cc7b6c27202ee8', 'request_id': 'req-46febb68-ef97-448e-957f-99e4e14accb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.053766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b3074b4ece46c8a3cc7b6c27202ee8', 'request_id': 'req-46febb68-ef97-448e-957f-99e4e14accb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.081922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] The token cache is being invalidate because project 84b3074b4ece46c8a3cc7b6c27202ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:54.082311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.083056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.092562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 833/1674] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:53 2022] DELETE /identity/v3/projects/84b3074b4ece46c8a3cc7b6c27202ee8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:54.093842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.100051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.106864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78b74c551ab49fdb1ddd531017e9e2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.133226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78b74c551ab49fdb1ddd531017e9e2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.134239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78b74c551ab49fdb1ddd531017e9e2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.149611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78b74c551ab49fdb1ddd531017e9e2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.169919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78b74c551ab49fdb1ddd531017e9e2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.177906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:54.190392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 842/1675] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:53 2022] DELETE /identity/v3/users/d78b74c551ab49fdb1ddd531017e9e2c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:54.190392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.191405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.271571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46febb68-ef97-448e-957f-99e4e14accb2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:54.455442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3425b-0c2c-4a3c-8b6a-0d0f6ae67ae7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:54.469893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:54.470518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.471023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.471438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] PATH_INFO: `/v3/projects/25949c4efc5441fea383641aab530e51` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.472729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25949c4efc5441fea383641aab530e51)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:54.475242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.477914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:54.481610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:54.482258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.482539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.483004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.487378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.541300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:54.542975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18316f7-bf63-4825-b15f-1641a1e0645e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.570606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 834/1676] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:54.571767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbfa09-94b4-40f0-ae59-c828bed4cda9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.572058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbfa09-94b4-40f0-ae59-c828bed4cda9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.572336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbfa09-94b4-40f0-ae59-c828bed4cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.591927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25949c4efc5441fea383641aab530e51', 'request_id': 'req-a6e72750-5232-487d-853c-4ec31c250a8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.618950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25949c4efc5441fea383641aab530e51', 'request_id': 'req-a6e72750-5232-487d-853c-4ec31c250a8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.629865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25949c4efc5441fea383641aab530e51', 'request_id': 'req-a6e72750-5232-487d-853c-4ec31c250a8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.650681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eefbfa09-94b4-40f0-ae59-c828bed4cda9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:54.654678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eefbfa09-94b4-40f0-ae59-c828bed4cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.660308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] The token cache is being invalidate because project 25949c4efc5441fea383641aab530e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:54.660618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.661444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a6e72750-5232-487d-853c-4ec31c250a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.666177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 843/1677] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:54 2022] DELETE /identity/v3/projects/25949c4efc5441fea383641aab530e51 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:54.671458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96760a0f-7140-48fb-bc15-3b86481e05f3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.672058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96760a0f-7140-48fb-bc15-3b86481e05f3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.672275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96760a0f-7140-48fb-bc15-3b86481e05f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.724285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-96760a0f-7140-48fb-bc15-3b86481e05f3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:54.727801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-96760a0f-7140-48fb-bc15-3b86481e05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.814184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 835/1678] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:54.818215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.818509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.818797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.863608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:54.865658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.882762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 836/1679] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:54.884090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.891247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 844/1680] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:54.900217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.900557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.900773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.919294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ff44-2c04-481e-b0aa-1858605fb726 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:54.938097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:54.939263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.940064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.941631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.942604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:54.945578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:54.947541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.951270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:54.953746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.974135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 845/1681] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:11:54.977105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.982648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 837/1682] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:54.988573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.003014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b36db-f13b-41a8-8996-4ef05effb55e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.009150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e702b-5848-4c74-9621-ea80e46975fb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.017571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.019565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.020893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.021813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.022600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.025562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:55.025872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.027519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.028161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.028689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.036873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.041632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.043408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.072513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 846/1683] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:55.074358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.080999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.133478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 838/1684] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:54 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:55.138859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.142080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faca68-227d-41fa-952d-65423f02006a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.263454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.264266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.264612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.264820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] PATH_INFO: `/v3/projects/b0e0d68a631d4a0e915c6f9ec93c093a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.272459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e0d68a631d4a0e915c6f9ec93c093a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.287687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.300825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:55.304554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:55.350018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1cd8-b755-4e42-b114-96ab6b8d8dcd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.358460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.359729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.360271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.360755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.361942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.367397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.386190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e0d68a631d4a0e915c6f9ec93c093a', 'request_id': 'req-18569407-d1e7-430b-8d32-1dc0d9059af8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.394278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e0d68a631d4a0e915c6f9ec93c093a', 'request_id': 'req-18569407-d1e7-430b-8d32-1dc0d9059af8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.417018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e0d68a631d4a0e915c6f9ec93c093a', 'request_id': 'req-18569407-d1e7-430b-8d32-1dc0d9059af8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.452777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] The token cache is being invalidate because project b0e0d68a631d4a0e915c6f9ec93c093a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:55.453070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.457289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.461710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 839/1685] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:55 2022] POST /identity/v3/projects => generated 369 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:55.463161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.470224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.479192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 847/1686] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:55 2022] DELETE /identity/v3/projects/b0e0d68a631d4a0e915c6f9ec93c093a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:55.479918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.482994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.627089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569407-d1e7-430b-8d32-1dc0d9059af8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.634272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7123a4-b520-43c4-8ec5-b81cdc41ba30 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.640913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.643637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.643890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.644170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.645851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.648511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.650610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.653209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.653209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.653411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.654018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.656280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.722705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 848/1687] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:55 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:55.728132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.730676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 840/1688] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:55 2022] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:55.732736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.735699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.769227 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0028a-2f72-411e-a931-bc28f2ebec78 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.774567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006bda-7f79-4873-aecd-e22f71b0a2fd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.781183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.784219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.784507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.784788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.787764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.789749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.790521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.790811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.791090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] PATH_INFO: `/v3/users/24bed29b715b4ba7b63a6c766464690e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.791735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.794828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bed29b715b4ba7b63a6c766464690e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.799317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.828804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 841/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:55.832860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.863571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dd800-0a06-4183-9487-9fa0e52c0ae2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.877488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.878154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.878484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.878938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.880169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.882029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.934399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 842/1690] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:55.936170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.945331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bed29b715b4ba7b63a6c766464690e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.967166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bed29b715b4ba7b63a6c766464690e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.971091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bed29b715b4ba7b63a6c766464690e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.973824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e952-f3fe-4c34-b61e-845d6f9da628 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.989392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.990077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.990519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.990798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.991471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.995938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bed29b715b4ba7b63a6c766464690e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.998101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.052029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 843/1691] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:56.053500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bed29b715b4ba7b63a6c766464690e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.057545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.062609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.071736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 849/1692] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:55 2022] DELETE /identity/v3/users/24bed29b715b4ba7b63a6c766464690e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.072735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.078651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.095805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca1a7-cac3-4d3f-829c-b7c020d37344 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.098543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:56.256054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.257037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.257606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.258100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.259153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.261030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f92e-35fc-4ef4-bb83-5b7f5e62bb07 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.265474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897f814-71ff-400e-98e5-98db3eac3a23 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.281454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.282189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.282470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.282744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] PATH_INFO: `/v3/projects/e0a49b0e8d0a4b0eb960ec300d474d46/users/38690dea26dd427bbf118672635a29c5/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.286688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 844/1693] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:56.288749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8dff-94c3-42c1-b655-6942d649d305 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.289283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8dff-94c3-42c1-b655-6942d649d305 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.289799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8dff-94c3-42c1-b655-6942d649d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.322197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a49b0e8d0a4b0eb960ec300d474d46, user_id=38690dea26dd427bbf118672635a29c5, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.326213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.347350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5a8c8dff-94c3-42c1-b655-6942d649d305 None None] MFA Rules not processed for user `67bb6da95fc446dcb4799b4f17bc882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.348903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a8c8dff-94c3-42c1-b655-6942d649d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.352555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 850/1694] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:56 2022] PUT /identity/v3/projects/e0a49b0e8d0a4b0eb960ec300d474d46/users/38690dea26dd427bbf118672635a29c5/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.353438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.373137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:56.507885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf4db-ca37-4d10-9cba-9de64138811e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.510846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 845/1695] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.512823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada17b-a247-4b23-88b0-f1adb62d3cfa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.513108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada17b-a247-4b23-88b0-f1adb62d3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.514410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada17b-a247-4b23-88b0-f1adb62d3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.521843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.522406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.522692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.523407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] PATH_INFO: `/v3/projects/f327c36627364a91a56bbf1cda21bf34/users/1ef9671dee1742e0bf401976b0455404/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.549022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f327c36627364a91a56bbf1cda21bf34, user_id=1ef9671dee1742e0bf401976b0455404, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.555813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91c52-0fa9-413a-b50a-e56ce3f2170b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.587048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 851/1696] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:56 2022] PUT /identity/v3/projects/f327c36627364a91a56bbf1cda21bf34/users/1ef9671dee1742e0bf401976b0455404/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.588982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.590387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.591222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.605723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f7ada17b-a247-4b23-88b0-f1adb62d3cfa None None] MFA Rules not processed for user `38690dea26dd427bbf118672635a29c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.608052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f7ada17b-a247-4b23-88b0-f1adb62d3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.656659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] MFA Rules not processed for user `67bb6da95fc446dcb4799b4f17bc882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.658672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.769783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 846/1697] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.773385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.773385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.773385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.787558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 852/1698] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.789482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.792177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.817721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:56.840340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] MFA Rules not processed for user `1ef9671dee1742e0bf401976b0455404`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.841684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.931066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dfb32-cdc7-4877-89d0-6467c4a0e000 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.938882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.942168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.942168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.942168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] PATH_INFO: `/v3/projects/8f69aedc8d034087b273167104a4bc5a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.943506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f69aedc8d034087b273167104a4bc5a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.946692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.977905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 847/1699] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.979178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.994632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0f05-b98c-4ec7-93ca-2ffc2d9b07d7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.000304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.000689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.001031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.001467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.002351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.005066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.046572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 848/1700] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:57.047462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.050441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.068610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.075622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f69aedc8d034087b273167104a4bc5a', 'request_id': 'req-4b099cf5-05a9-4d1c-968c-d8d4827d5391'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.096037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f69aedc8d034087b273167104a4bc5a', 'request_id': 'req-4b099cf5-05a9-4d1c-968c-d8d4827d5391'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.111489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f69aedc8d034087b273167104a4bc5a', 'request_id': 'req-4b099cf5-05a9-4d1c-968c-d8d4827d5391'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.142552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] The token cache is being invalidate because project 8f69aedc8d034087b273167104a4bc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:57.142879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.143516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.149201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 853/1701] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:56 2022] DELETE /identity/v3/projects/8f69aedc8d034087b273167104a4bc5a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:57.149201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.153806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.239634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbc0-bd66-4e07-8785-c79b33178c72 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.253009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.253721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.254008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.254284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.260221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.382595 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099cf5-05a9-4d1c-968c-d8d4827d5391 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.430319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.432133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.466082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 849/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:57.467269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.471782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.488892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.516304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.516304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.516304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.516304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] PATH_INFO: `/v3/users/0efe8a52f2404587b05032b689efcdb7` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.520059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efe8a52f2404587b05032b689efcdb7)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.524262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.650054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8ab8-81c5-4b5b-89a3-b8de8da4abaf service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.653976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efe8a52f2404587b05032b689efcdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.666713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.669462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.669781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.670055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.670724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.672631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efe8a52f2404587b05032b689efcdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.673923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efe8a52f2404587b05032b689efcdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.676764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064ff1-9f01-4d78-b4d0-251fbeaaa6fe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.701395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efe8a52f2404587b05032b689efcdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.727241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efe8a52f2404587b05032b689efcdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.737760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 854/1703] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:57 2022] DELETE /identity/v3/users/0efe8a52f2404587b05032b689efcdb7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:57.742516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.749095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.754943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 850/1704] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/projects => generated 405 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:57.757964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.758422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.758858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.786767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:57.788765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.861102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.916203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4086141-a314-49fd-b4ab-eb0c8b415e15 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.939490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 851/1705] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.948047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.950042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.963181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752c26-e433-4135-9168-1ae438e6d95d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.983639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.984308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.985976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.986274 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] PATH_INFO: `/v3/projects/82b0cb1a71824ee9ba992441a9941167` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.987760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b0cb1a71824ee9ba992441a9941167)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.989893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.082755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b0cb1a71824ee9ba992441a9941167', 'request_id': 'req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.083677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.086885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.087319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.087693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.100225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b0cb1a71824ee9ba992441a9941167', 'request_id': 'req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.100783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.106833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.114362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b0cb1a71824ee9ba992441a9941167', 'request_id': 'req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.143574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] The token cache is being invalidate because project 82b0cb1a71824ee9ba992441a9941167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:58.144029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.144891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc44dab5-9ca2-43a8-aa0b-ab003028dddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.148807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 852/1706] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:57 2022] DELETE /identity/v3/projects/82b0cb1a71824ee9ba992441a9941167 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:58.150300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b263-0c77-42b5-a1f7-ecf73d9ff337 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.150584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b263-0c77-42b5-a1f7-ecf73d9ff337 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.150859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b263-0c77-42b5-a1f7-ecf73d9ff337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.153126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 855/1707] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/users => generated 291 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.154557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.156545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.169757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791a515-282b-414a-ac8e-ded1c04abdb8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.183999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.224512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9404b263-0c77-42b5-a1f7-ecf73d9ff337 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.225706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9404b263-0c77-42b5-a1f7-ecf73d9ff337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.300065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.304175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.305645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.305944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.306612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.312298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f22d8-bd63-4528-94dc-c768a87b1239 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.365268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 856/1708] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/users => generated 309 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.367308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.367896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.368319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.387209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 853/1709] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.389115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8122-e4f4-4785-bc0f-31b71a97fb74 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.389115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8122-e4f4-4785-bc0f-31b71a97fb74 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.389391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8122-e4f4-4785-bc0f-31b71a97fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.421376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.430369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.431862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 857/1710] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.431977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ae7d8122-e4f4-4785-bc0f-31b71a97fb74 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.433240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae7d8122-e4f4-4785-bc0f-31b71a97fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.436342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.437730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.449313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 854/1711] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.449313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb88de-261d-4f14-9729-b171a484a156 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.449313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb88de-261d-4f14-9729-b171a484a156 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.449313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb88de-261d-4f14-9729-b171a484a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.451555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82aa3-5351-4a70-b116-363379f3df0e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.456863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.457622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.457943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.458279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.458991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.460676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.468644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4fbb88de-261d-4f14-9729-b171a484a156 None None] MFA Rules not processed for user `c68a9247d24247c5ab68e929625bac4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.469923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4fbb88de-261d-4f14-9729-b171a484a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.476107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 858/1712] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.476107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.489724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc849b5-b060-48ac-8f2c-e882d06cf01c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.496268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.497078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.497916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.498334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.499143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.502336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737257f-6fb7-4ee0-bb57-65c485dfddeb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.514654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 859/1713] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.515991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.516368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.516748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.518320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 860/1714] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 29 02:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:58.519021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.520764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.530583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.550586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 855/1715] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.552036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34c09-123b-4f83-a712-101d9a16feee None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.552751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34c09-123b-4f83-a712-101d9a16feee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.552751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f34c09-123b-4f83-a712-101d9a16feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.586361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e9f34c09-123b-4f83-a712-101d9a16feee None None] MFA Rules not processed for user `47de15dc16c54bcfa3ebf300fc590cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.588203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e9f34c09-123b-4f83-a712-101d9a16feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.643936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c811a-af9e-49ef-83fb-b673bd6d9c4d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.649274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.650794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.651081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.651359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.665911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.667927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.685035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 861/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:58.685947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.693951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 856/1717] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.696383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.697935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.699319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.706883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc8411-6038-4445-8556-733752c576cf service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.720073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.720696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.720980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.721255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.721949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:58.722254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.726796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.747255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.751199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.761155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 862/1718] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:58.763308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.775496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 857/1719] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.776858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.778038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1474-889e-40c2-97aa-74ab98ae6f6b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.784098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.785081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.786367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.786815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] PATH_INFO: `/v3/projects/c4f4317e3e724db09128d8b1e5856cc1/users/055553ee40754922b854cf4001891605/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.804984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d4406-b524-4ea3-9959-fce299fb8b43 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.805998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4317e3e724db09128d8b1e5856cc1, user_id=055553ee40754922b854cf4001891605, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.810257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3fffb-6332-4f1c-aacd-9999d4d6cc08 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.825770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.827184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.827533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.827826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] PATH_INFO: `/v3/projects/35b2af81a12d400f8ee141dc99edd7ee/users/6b65ce1057614e6e8f8361988b117a66/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.836111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 863/1720] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:58 2022] PUT /identity/v3/projects/c4f4317e3e724db09128d8b1e5856cc1/users/055553ee40754922b854cf4001891605/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:58.839600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.840269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.840626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.864362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b2af81a12d400f8ee141dc99edd7ee, user_id=6b65ce1057614e6e8f8361988b117a66, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.868332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c728c2-2398-4c11-b1c7-557b54c09d9d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.899547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 858/1721] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:58 2022] PUT /identity/v3/projects/35b2af81a12d400f8ee141dc99edd7ee/users/6b65ce1057614e6e8f8361988b117a66/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:58.901024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.901419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.903313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.904891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.905192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.928504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.977889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] MFA Rules not processed for user `47de15dc16c54bcfa3ebf300fc590cff`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.987978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.996355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 864/1722] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.997120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.100600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 859/1723] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:59.103062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.130764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74779970-0674-4ff8-a88c-8b7537489e64 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.140666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.141614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.141915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.142322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.142964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.144877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.203505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 865/1724] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:59.205254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.216668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.221875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd640e5-bc80-4294-884a-2e62b53fd20b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.312011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8df-a748-4a96-9e83-66da1c9b77fe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.312883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.313586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.313885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.314337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.315077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:59.315388 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.317189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.317306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.317841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.318121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.318393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.319027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.321889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.340273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 860/1725] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:59.340273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.340483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 866/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:59.340742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.352089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124b09-6696-4ee2-9e5e-945a6ec56b22 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.358392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.359108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.359460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.359802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.360523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.362758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.380166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 861/1727] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:59.384214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.386149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.404189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da1d0d-06d6-4d21-969d-0690bf5c97ba admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.410063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.410730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.411015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.411300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] PATH_INFO: `/v3/projects/f17fdf0bb4b54ad6a5eb185a777cec41` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.412503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17fdf0bb4b54ad6a5eb185a777cec41)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.414431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.422006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3505-7c48-4f37-a1c4-8804946eef02 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.426417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.427286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.427567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.428245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.434059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.439990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.441877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.452959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 867/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:59.453918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.469863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769aacf-d2cb-48d0-892e-c434db9e8db9 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.476998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.477342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.477739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.478012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.480189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.482962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c9e5b-db6f-429e-86e6-8736e2f2ab5f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.526093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 868/1729] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/users => generated 292 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:59.531510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff000b-3c7e-4971-9719-4bed8e267f88 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.531946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff000b-3c7e-4971-9719-4bed8e267f88 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.532222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff000b-3c7e-4971-9719-4bed8e267f88 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.534092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 869/1730] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 29 02:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:59.534944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff000b-3c7e-4971-9719-4bed8e267f88 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.562031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17fdf0bb4b54ad6a5eb185a777cec41', 'request_id': 'req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:59.573904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17fdf0bb4b54ad6a5eb185a777cec41', 'request_id': 'req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:59.582989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17fdf0bb4b54ad6a5eb185a777cec41', 'request_id': 'req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:59.607965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] The token cache is being invalidate because project f17fdf0bb4b54ad6a5eb185a777cec41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:59.608261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:59.609200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:59.615081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 862/1731] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:59 2022] DELETE /identity/v3/projects/f17fdf0bb4b54ad6a5eb185a777cec41 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:59.616136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.617738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.696189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff000b-3c7e-4971-9719-4bed8e267f88 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.712727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.713697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.714010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.714481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] PATH_INFO: `/v3/projects/c4f4317e3e724db09128d8b1e5856cc1/users/055553ee40754922b854cf4001891605/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.721647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4317e3e724db09128d8b1e5856cc1, user_id=055553ee40754922b854cf4001891605, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.724343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.746332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a76c-967e-4f06-a56d-3f5107fa4f09 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.757608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 870/1732] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:59 2022] PUT /identity/v3/projects/c4f4317e3e724db09128d8b1e5856cc1/users/055553ee40754922b854cf4001891605/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:59.757608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.757608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.780441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.902525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.903186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.903471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.903745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.904397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.906803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.926855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a4d5-5bed-40a7-bb20-ba2630dd8136 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.932438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.934575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.934999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.935529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] PATH_INFO: `/v3/projects/35b2af81a12d400f8ee141dc99edd7ee/users/6b65ce1057614e6e8f8361988b117a66/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.939510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b2af81a12d400f8ee141dc99edd7ee, user_id=6b65ce1057614e6e8f8361988b117a66, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.943077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fd1-dedb-4534-96b9-ec162d8ce643 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.968720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 863/1733] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/projects => generated 367 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:59.968720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.971364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.976927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 871/1734] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:59 2022] PUT /identity/v3/projects/35b2af81a12d400f8ee141dc99edd7ee/users/6b65ce1057614e6e8f8361988b117a66/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:59.978556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e564c-9ea4-42d4-bb62-6ab6fa1dcf69 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.978870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e564c-9ea4-42d4-bb62-6ab6fa1dcf69 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.979187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e564c-9ea4-42d4-bb62-6ab6fa1dcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.085221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9e2e564c-9ea4-42d4-bb62-6ab6fa1dcf69 None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.086739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9e2e564c-9ea4-42d4-bb62-6ab6fa1dcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.093615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ced9c-33b0-4909-8e2d-06d4a5c1cbd5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.107451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.108098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.108378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.108648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.109303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.111013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b9b5-0b1b-4ae9-86be-328b46a2b01a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.130184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 864/1735] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.134518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.134805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.135083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.179169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 872/1736] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.180543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.181001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.181374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.200322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.201684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.215075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:00.221375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 865/1737] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.221375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.225286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] MFA Rules not processed for user `055553ee40754922b854cf4001891605`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.229758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7e7ac-0bb5-4761-b973-812da2b90a67 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.232025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.237106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.238041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.238475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.238922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.239737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.242052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e449bd4-4655-4c0c-b805-25492afedf6d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.276298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 866/1738] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:00.276298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.276298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.276298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.315270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] MFA Rules not processed for user `6b65ce1057614e6e8f8361988b117a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.316622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.347313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 873/1739] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.349689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.351145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.404717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:00.409311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 867/1740] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.410513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.424772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eec98b-b4f8-4174-ac97-ac3a172d5bd4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.431573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.432262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.433568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.433893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.435187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.436483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.445022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062559ce-2c90-4491-a302-c984815b5b13 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.454256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 868/1741] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.454435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.454435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.454608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.454687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.454687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.454834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.456420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.470586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c10b6-c867-4209-8fd3-3e87a479978d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.476413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.477055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.477343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.477698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.487614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.491602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.508825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 869/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.509975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.512160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.534817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.537058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975c0a4-ceb8-42ae-930c-804af790df1c service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.547588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 874/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.553472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.553847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.554246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.587343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.590172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.610503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 875/1744] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.611324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.627126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573080-493d-419f-a89b-2af6e0098da6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.633807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.634593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.634964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.635295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.636191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.638433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.658074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 876/1745] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.662477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.664837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.672713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137b286-6d1f-4b21-95cd-47c906d0e60d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.681090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.681790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.682074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.682349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.688404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.711889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:00.713826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.717446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.744361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 870/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.745938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.748769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.774608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81632-8e02-4543-bfee-147b9ecc1416 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.784132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.785075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.785529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.786239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.814768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.817722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.837920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 877/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.841759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.860984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9319c5f-5fd2-4dd2-8c84-5e107721e83d service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.869478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.871010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.875166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.875608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] PATH_INFO: `/v3/projects/b86b16094d5b45cda08956b917de54f0/users/7ea18b3eae0343ad93293827a1333e85/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.879605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde827-df25-4cbd-ae41-869f38db4245 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.896691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.897752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.898170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.898545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.902526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86b16094d5b45cda08956b917de54f0, user_id=7ea18b3eae0343ad93293827a1333e85, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.908813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.931344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.942485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.942690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 878/1748] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:00 2022] PUT /identity/v3/projects/b86b16094d5b45cda08956b917de54f0/users/7ea18b3eae0343ad93293827a1333e85/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:00.943629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.969409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 871/1749] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.972043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.985491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0113e-21ca-4ea4-b7ed-a620c60762ee service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.164598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99e20-20c9-4634-bca4-e41523660d7e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.175590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.176417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.176927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.177305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.178247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:01.178666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.181144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.182071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.182579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.183065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.183501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.184424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.186920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84148271-811b-40ac-8783-1c86a2025330 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.218095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 879/1750] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:01.219533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.239862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 872/1751] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:01.241244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.241557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.246050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.297392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:01.357849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d630656-8b1a-406a-8a1b-7e723480db7f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.369193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] MFA Rules not processed for user `7ea18b3eae0343ad93293827a1333e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:01.370754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.371675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.372080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.372471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.373696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:01.378071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:01.494863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:01.525148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.530019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.580893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 880/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:01.583816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.618147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 873/1753] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:01.625165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.639699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083dec-fd29-4fa3-86d5-25d0fcdc273b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.646151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.647112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.647536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.647947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] PATH_INFO: `/v3/projects/fbe425c9317a4132a575652346a6096f/users/c8a8f1a26ece40259aef445254806f9c/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.660656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71788-4717-491e-b141-a38dee82bfd6 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.681862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe425c9317a4132a575652346a6096f, user_id=c8a8f1a26ece40259aef445254806f9c, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.687454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.702479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.703126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.706868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.707432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.710432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.717732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.730756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 874/1754] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:01 2022] PUT /identity/v3/projects/fbe425c9317a4132a575652346a6096f/users/c8a8f1a26ece40259aef445254806f9c/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:01.732091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.829398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 881/1755] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:01 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:01.830378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.835338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6061ff-811b-4f43-80b9-1e132bfc642b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.985341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bbb96-00a5-4014-ba8e-7bdc95ddb4ca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.001125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.001791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.002079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.002783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.015504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.016158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.016528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.016810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.017464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.019466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047a745-a693-4881-964c-f6e993f8b1d7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.023212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:02.152365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:02.187557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.189427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844adc9-bd71-48b9-851a-e00a0a93f3d6 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.208530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 875/1756] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:02.210066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.210326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.210607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.221097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 882/1757] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:02.223584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.223874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.224149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.307648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] MFA Rules not processed for user `67bb6da95fc446dcb4799b4f17bc882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:02.313161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:02.317372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] MFA Rules not processed for user `c8a8f1a26ece40259aef445254806f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:02.319312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:02.528463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 883/1758] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:02.529469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.597590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 876/1759] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:02.598556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.777375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979e704-2064-4c6a-8b1b-c85325903e58 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.785682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.787724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.788313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.788595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.790251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.793581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.804237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:02.844785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf1106-d188-48ca-b887-7536a85f71d8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.850749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 877/1760] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:02.850749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.855056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.855767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.856061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.856427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.856961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.858968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.874822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011415d9-4d89-48e7-a9e2-9cef8c43932c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.884774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.885809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.886858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.887376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.888218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.890486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.928314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 884/1761] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:02.937273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.956731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86575216-6e19-4cd9-8d27-91c5a2895dc5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.961394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 878/1762] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:02.962535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.078927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:03.120656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.122773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.123918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.124451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.125688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.127973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.184082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 885/1763] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.185339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.216103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9f98-1fd0-4bad-b57b-333b06eafada admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.242983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.245214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.255227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.255883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.259043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.263010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.263177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e899de-c03f-4f21-a515-9649a2b55bf1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.299573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.300573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.300960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.301214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.321538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 886/1764] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:03 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:03.324823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.326245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.329471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.373038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 879/1765] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.374279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.378803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3315a1-a267-441b-bfb7-ea37e0147e67 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.397709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.398592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.398804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.399094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] PATH_INFO: `/v3/projects/04ceac288f674980ab5a450ad51b41ae/users/c7bf43c3cd3546739b20ef6a494b0961/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.410797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474cd9-f050-4952-89da-52836f49b5f7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.423624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.424381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.424926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.425322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.426139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.429654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.458693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ceac288f674980ab5a450ad51b41ae, user_id=c7bf43c3cd3546739b20ef6a494b0961, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.467198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.467412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 880/1766] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.469910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.508278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 887/1767] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:03 2022] PUT /identity/v3/projects/04ceac288f674980ab5a450ad51b41ae/users/c7bf43c3cd3546739b20ef6a494b0961/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:03.509126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.519450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0e296-abef-4cd8-9426-faad35be005d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.758118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.758118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.758118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.758118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.758592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.760019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.779303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 881/1768] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.779303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.791365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac776c-d4be-48fb-881f-3e87d72d463d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.803634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018e14-031d-4b54-8500-1abc72e16903 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.803744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.803744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.803744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.803744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.804072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.804072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.819850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.822295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.822701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.824466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] PATH_INFO: `/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922/users/b5e5c83e4779407ca5e9a8c89501e869/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.832618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 882/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.833841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.847266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a904d-afad-48e7-bc72-94fd00445509 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.853724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.855226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.855779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.856805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] PATH_INFO: `/v3/projects/87e6debc781d4b11bac43bbd06fef09b/users/e0fd0d7bc2f148cdb637d90afa9bd562/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.880313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e6debc781d4b11bac43bbd06fef09b, user_id=e0fd0d7bc2f148cdb637d90afa9bd562, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.881284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f43a5c4f5e34593a34d1fbf72d01922, user_id=b5e5c83e4779407ca5e9a8c89501e869, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.884143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0ff1d-f88b-4b86-aa16-8381a8ddf4b7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.884279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.906598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 883/1770] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:03 2022] PUT /identity/v3/projects/87e6debc781d4b11bac43bbd06fef09b/users/e0fd0d7bc2f148cdb637d90afa9bd562/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:03.908260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.933457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 888/1771] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:03 2022] PUT /identity/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922/users/b5e5c83e4779407ca5e9a8c89501e869/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:03.935077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.935432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.935989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.004971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] MFA Rules not processed for user `e0fd0d7bc2f148cdb637d90afa9bd562`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:04.007069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:04.026773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:04.074653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4a9ee-840b-4a63-adf2-90cf19bf0426 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.164479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:04.168783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 889/1772] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:04.176114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.258859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.259839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.260122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.260439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] PATH_INFO: `/v3/projects/04ceac288f674980ab5a450ad51b41ae/users/c7bf43c3cd3546739b20ef6a494b0961/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.264019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ceac288f674980ab5a450ad51b41ae, user_id=c7bf43c3cd3546739b20ef6a494b0961, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.268408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.306078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 884/1773] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:03 2022] PUT /identity/v3/projects/04ceac288f674980ab5a450ad51b41ae/users/c7bf43c3cd3546739b20ef6a494b0961/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:04.306918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.388029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f68e1-8b1b-48f3-953b-19ae61eadbcb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.493534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7219-4f67-4ec3-b099-ac21b2e6f43b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.507060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.507946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.508059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.508868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.509527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.515882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abd51b-792e-4757-b7a8-4e458fb77e03 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.577422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.579654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.579947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.580221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.581447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.586146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 885/1774] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:04 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:04.586494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.590751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.591156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.592060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.616236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 890/1775] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:04.617205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.643236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423cba3-0e81-4675-8790-4157e6159cac admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.689373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] MFA Rules not processed for user `c7bf43c3cd3546739b20ef6a494b0961`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:04.693767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:04.818675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:04.839450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.840347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.841840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.842118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.842785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.852195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.901986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 891/1776] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:04 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:04.901986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.924794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 886/1777] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:04.925875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.937918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c073-55bc-4a0c-8e01-bfa31bc858b7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.950983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe870d2e-e42b-4613-a439-b602eb74e4a0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.951580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.953548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.954481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.955127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] PATH_INFO: `/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922/users/b5e5c83e4779407ca5e9a8c89501e869/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.960925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f43a5c4f5e34593a34d1fbf72d01922, user_id=b5e5c83e4779407ca5e9a8c89501e869, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.963040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.966148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.967076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.967358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.969284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.969588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.980590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.006543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 892/1779] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:04 2022] PUT /identity/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922/users/b5e5c83e4779407ca5e9a8c89501e869/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.006937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 887/1779] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:05.007829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.008813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.034400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06e02-62e9-419c-bab7-a4c93e571ca8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.093931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:05.158412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b09ed-5c5f-4073-8590-c9697fca9c7a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.171342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.172092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.173928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.174206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.227928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.228682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.228954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.229271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] PATH_INFO: `/v3/projects/b2a5a654be6f4e6f9eaeca0699963090/users/e2d4f29115f64d76b20185d9816f18ae/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.267981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a5a654be6f4e6f9eaeca0699963090, user_id=e2d4f29115f64d76b20185d9816f18ae, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.270711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32f9b0-8cc9-4e30-838f-57394b089004 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.302720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 888/1780] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:05 2022] PUT /identity/v3/projects/b2a5a654be6f4e6f9eaeca0699963090/users/e2d4f29115f64d76b20185d9816f18ae/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.303123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.303461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.303742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.318262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.320354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.358157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 893/1781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:05.359091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.373602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] MFA Rules not processed for user `b5e5c83e4779407ca5e9a8c89501e869`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:05.374775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:05.386739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6a2-a7d5-441a-ba99-b3c37f4345fd service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.558390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.559146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.559537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.559914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.560702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.562684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.576889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 889/1782] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:05.579220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.595813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 894/1783] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:05.597008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.610326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c28a2-a87e-4452-9697-63c7b2de0385 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.617404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.618141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.618431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.618704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] PATH_INFO: `/v3/users/7ea18b3eae0343ad93293827a1333e85` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.620068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea18b3eae0343ad93293827a1333e85)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.622514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.629564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:05.732797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a137074-a81d-4d1b-a71d-32f905a75fd7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.733572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea18b3eae0343ad93293827a1333e85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:05.741358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.741972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.742258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.742513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.751509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea18b3eae0343ad93293827a1333e85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:05.753124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea18b3eae0343ad93293827a1333e85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:05.754173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea18b3eae0343ad93293827a1333e85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:05.765472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6457ebfb-bead-4dce-8a7a-9a09b292f949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea18b3eae0343ad93293827a1333e85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:05.767707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.769781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.783815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 895/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:05.785319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.813463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ed6-fc8e-4307-993b-6986b6438ed6 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.822180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 890/1785] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:05 2022] DELETE /identity/v3/users/7ea18b3eae0343ad93293827a1333e85 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.825743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.826674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.826952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.828434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] PATH_INFO: `/v3/projects/b2a5a654be6f4e6f9eaeca0699963090/users/e2d4f29115f64d76b20185d9816f18ae/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.828733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0464-a43d-4c74-8153-18dff22ce7ea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.829138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0464-a43d-4c74-8153-18dff22ce7ea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.831125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0464-a43d-4c74-8153-18dff22ce7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.832871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a5a654be6f4e6f9eaeca0699963090, user_id=e2d4f29115f64d76b20185d9816f18ae, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.837681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8cd74-e93c-4cc3-8211-02f5d8db9ae6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.852126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:05.865777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 896/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:05 2022] PUT /identity/v3/projects/b2a5a654be6f4e6f9eaeca0699963090/users/e2d4f29115f64d76b20185d9816f18ae/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.876526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.876796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.877092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.884026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-653b0464-a43d-4c74-8153-18dff22ce7ea None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:05.888352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-653b0464-a43d-4c74-8153-18dff22ce7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.021563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:06.023707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.052178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 891/1787] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:06.053740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982792b6-f973-49bc-a247-c18781467016 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.053976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982792b6-f973-49bc-a247-c18781467016 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.054262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982792b6-f973-49bc-a247-c18781467016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.205434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-982792b6-f973-49bc-a247-c18781467016 None None] MFA Rules not processed for user `e2d4f29115f64d76b20185d9816f18ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:06.207471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-982792b6-f973-49bc-a247-c18781467016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.317288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 897/1788] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:06.324116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:06.333185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.410254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 892/1789] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:06.484191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982792b6-f973-49bc-a247-c18781467016 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:06.486677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-982792b6-f973-49bc-a247-c18781467016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.526768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f805-4b9a-4914-a511-90cf356e6488 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:06.534873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:06.535449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.535836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.536304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.559687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:06.561350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:06.578740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982792b6-f973-49bc-a247-c18781467016 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:06.584673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:06.585397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 898/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:06.587403 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:06.591088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:06.595511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.603343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.603850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.641003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:06.645059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:06.650080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:06.707478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 893/1791] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:06.888275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f093a-cd5c-426f-ab76-6c249e1db85c service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:06.897647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:06.899053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.899053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.899053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.911182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:06.913915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f733e-5d19-4393-8147-fae6f645dbdd service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:06.947257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 899/1792] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:12:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:12:07.525471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:07.527889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:07.543901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1bd8-0c31-4eb6-91a1-2d8d94a3b4aa service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:07.565973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:07.566377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:07.566653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:07.567065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:07.570581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:07.702377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:07.819499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:07.823080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:07.857764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 894/1793] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:07.860853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:07.862037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:07.862574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:07.880613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:07.891008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:07.940620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:07.944725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:07.961979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849771-a675-46b6-b744-0175823c6250 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:07.967058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 900/1794] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 29 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:07.977794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:07.981370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:07.982021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:07.982549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:07.982822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] PATH_INFO: `/v3/projects/b86b16094d5b45cda08956b917de54f0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:07.984213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:07.985711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86b16094d5b45cda08956b917de54f0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:07.992013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:08.002872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8a82-383a-4fad-91ad-48d331c2f57d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:08.010455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:08.013490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:08.014256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:08.014742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:08.056216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:08.064273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:08.097932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 901/1795] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:08.158601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86b16094d5b45cda08956b917de54f0', 'request_id': 'req-017ba50c-7c7f-4016-9e86-a716c49afc7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.178620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86b16094d5b45cda08956b917de54f0', 'request_id': 'req-017ba50c-7c7f-4016-9e86-a716c49afc7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.196021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86b16094d5b45cda08956b917de54f0', 'request_id': 'req-017ba50c-7c7f-4016-9e86-a716c49afc7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.223099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] The token cache is being invalidate because project b86b16094d5b45cda08956b917de54f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:08.223529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.224784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.231613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 895/1796] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:07 2022] DELETE /identity/v3/projects/b86b16094d5b45cda08956b917de54f0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:08.232014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:08.261178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144636e-7ff8-4d0d-b59e-4db094011650 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:08.567772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:08.568577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:08.568860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:08.569140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] PATH_INFO: `/v3/users/c7bf43c3cd3546739b20ef6a494b0961` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:08.574021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bf43c3cd3546739b20ef6a494b0961)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:08.576417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:08.759860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bf43c3cd3546739b20ef6a494b0961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.794280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bf43c3cd3546739b20ef6a494b0961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.802017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bf43c3cd3546739b20ef6a494b0961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.821854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bf43c3cd3546739b20ef6a494b0961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.848437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:08.865453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-98a758b3-8716-4a5a-b042-89188e9cb712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bf43c3cd3546739b20ef6a494b0961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.879930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 902/1797] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:08 2022] DELETE /identity/v3/users/c7bf43c3cd3546739b20ef6a494b0961 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:09.303165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:09.306113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:09.329291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba50c-7c7f-4016-9e86-a716c49afc7f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:09.466200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:09.466882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:09.467209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:09.467494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] PATH_INFO: `/v3/users/38690dea26dd427bbf118672635a29c5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:09.468758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38690dea26dd427bbf118672635a29c5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:09.484732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:09.619063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38690dea26dd427bbf118672635a29c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:09.654531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38690dea26dd427bbf118672635a29c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:09.655498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38690dea26dd427bbf118672635a29c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:09.657298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38690dea26dd427bbf118672635a29c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:09.668289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:09.684688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38690dea26dd427bbf118672635a29c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:09.758837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 896/1798] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:09 2022] DELETE /identity/v3/users/38690dea26dd427bbf118672635a29c5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:09.760487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:09.760781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:09.761247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:09.818724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:09.820492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:10.002494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 903/1799] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:10.081024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:10.082948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:10.274859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:10.276615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:10.327185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b79cc-46eb-4a47-9e0a-d231276ed185 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:10.340013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509318-f11c-43c0-95fd-4e1c82340a3b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:10.341343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:10.342732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:10.343119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:10.343482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:10.362994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:10.363622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:10.363883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:10.364510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] PATH_INFO: `/v3/users/1ef9671dee1742e0bf401976b0455404` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:10.368481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef9671dee1742e0bf401976b0455404)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:10.369659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:10.373897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:10.375233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1a879-6d94-49e8-90c2-58893c55366e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:10.404566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 897/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:10.536002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef9671dee1742e0bf401976b0455404'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:10.569813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef9671dee1742e0bf401976b0455404'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:10.570628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef9671dee1742e0bf401976b0455404'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:10.592338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef9671dee1742e0bf401976b0455404'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:10.640196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef9671dee1742e0bf401976b0455404'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:10.680242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 904/1801] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:10 2022] DELETE /identity/v3/users/1ef9671dee1742e0bf401976b0455404 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:10.682772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:10.683136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:10.683687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:10.732595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:10.748131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:10.989639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 898/1802] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:11.160231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:11.162019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.327248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e1b32-11ed-4806-a32e-eb449b27055c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:11.335476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:11.337692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.338876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.339285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.368950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:11.372481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb647b-d899-4fee-8c97-e4982437bbca service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:11.401932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 905/1803] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:11.448373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:11.452414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.473693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27256e1d-90c2-469f-9845-f7ff9d57d335 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:11.481132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:11.482120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.482598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.483029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] PATH_INFO: `/v3/projects/04ceac288f674980ab5a450ad51b41ae` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.485409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ceac288f674980ab5a450ad51b41ae)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:11.489545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:11.639860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ceac288f674980ab5a450ad51b41ae', 'request_id': 'req-01683544-310e-4d7a-b3ff-278a1b1631b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.649751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ceac288f674980ab5a450ad51b41ae', 'request_id': 'req-01683544-310e-4d7a-b3ff-278a1b1631b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.678453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ceac288f674980ab5a450ad51b41ae', 'request_id': 'req-01683544-310e-4d7a-b3ff-278a1b1631b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.696880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:11.703153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] The token cache is being invalidate because project 04ceac288f674980ab5a450ad51b41ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:11.704643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.705883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.708373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 899/1804] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:11 2022] DELETE /identity/v3/projects/04ceac288f674980ab5a450ad51b41ae => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:11.715248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca4f-b825-442c-a6b1-920eca3b689b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.715460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca4f-b825-442c-a6b1-920eca3b689b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.715556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca4f-b825-442c-a6b1-920eca3b689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.731357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:11.751343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-78eaca4f-b825-442c-a6b1-920eca3b689b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:11.755360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-78eaca4f-b825-442c-a6b1-920eca3b689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.860614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:11.862741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.997294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 906/1805] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:12.000855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800a7f-1c1e-45de-8b5c-e41a7840327d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.001172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800a7f-1c1e-45de-8b5c-e41a7840327d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.001579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800a7f-1c1e-45de-8b5c-e41a7840327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.051695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683544-310e-4d7a-b3ff-278a1b1631b6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.082757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.083903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.084676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.085298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] PATH_INFO: `/v3/users/c8a8f1a26ece40259aef445254806f9c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.099402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e2800a7f-1c1e-45de-8b5c-e41a7840327d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:12.106576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e2800a7f-1c1e-45de-8b5c-e41a7840327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.112315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a8f1a26ece40259aef445254806f9c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.121911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.137638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 907/1806] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:12.143580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4a1c-d215-439a-ba68-a4e9099f12e1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.145272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4a1c-d215-439a-ba68-a4e9099f12e1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.147910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4a1c-d215-439a-ba68-a4e9099f12e1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.156649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 908/1807] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:12:12 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:12:12.157710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4a1c-d215-439a-ba68-a4e9099f12e1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.208101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4a1c-d215-439a-ba68-a4e9099f12e1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.223638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.237721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.243215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.244676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.248195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:12.249149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.253213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.295333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 909/1808] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:12.296313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.304099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a8f1a26ece40259aef445254806f9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.325273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ccc86-884f-4822-a413-a0179a7004ba admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.337805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.338834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.340119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.340596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.341948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.342082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a8f1a26ece40259aef445254806f9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.344229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b0f98-c412-4cdc-8011-f30dc26bda9b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.358462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a8f1a26ece40259aef445254806f9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.363958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a8f1a26ece40259aef445254806f9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.376760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a8f1a26ece40259aef445254806f9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.440200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 910/1809] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:12 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:12.441848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12307-190e-4d90-a1fc-6265eedce357 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.442096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12307-190e-4d90-a1fc-6265eedce357 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.446292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12307-190e-4d90-a1fc-6265eedce357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.461562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 900/1810] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:11 2022] DELETE /identity/v3/users/c8a8f1a26ece40259aef445254806f9c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:12.461562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.461562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.507746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0be12307-190e-4d90-a1fc-6265eedce357 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:12.510214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0be12307-190e-4d90-a1fc-6265eedce357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.651772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 911/1811] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:12.653636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.653949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.654228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.685239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:12.687813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.729962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd7a9-f0be-4d4c-8a99-c079782cf4bc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.790761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:12.879591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:12.913751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 912/1812] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:12.914954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.917603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.937199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.938229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.938767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.939110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.940767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.945200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09dd4-92d7-4f0a-b2e7-2815044ebbfd None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.948129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.956156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.957159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.957610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.958838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.975987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.982943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.010957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 913/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:13.021544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.022650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 901/1814] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:12 2022] POST /identity/v3/users => generated 294 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:13.023871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.025777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:13.055445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a775-becc-43f2-b907-f65a383d93eb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.072159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.074654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.075882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.076960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.077792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.083268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.124012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 902/1815] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:13.125648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.160983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4deb-2cb9-49cd-ace3-5bfa62f44c19 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.174977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.175589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.177460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.177785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.179985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.185429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.208392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d37b8-fa1c-4d1e-8fda-88e9a5ba21d3 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.211963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 903/1816] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:13.217050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.219066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.220064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.220641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.221207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.229894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df37db-bc43-4180-b47c-dad9799f957b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.237968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.239558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc0632-1e18-456a-9458-3663ef818671 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.249995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.250688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.250974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.251255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] PATH_INFO: `/v3/projects/6058bbaca4f64d33a62148fb82b930a7/users/f14653dab8b942c8b127bf7d729288c0/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.251951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 914/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:13.278677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6058bbaca4f64d33a62148fb82b930a7, user_id=f14653dab8b942c8b127bf7d729288c0, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.281423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.312407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 904/1818] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:13 2022] PUT /identity/v3/projects/6058bbaca4f64d33a62148fb82b930a7/users/f14653dab8b942c8b127bf7d729288c0/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:13.314632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.314927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.315228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.375168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] MFA Rules not processed for user `f14653dab8b942c8b127bf7d729288c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:13.376490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:13.531761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.533802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:13.539266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 915/1819] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:13.545477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:13.744499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e39dc5-1784-46f6-a336-667471b36753 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.759661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.760859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.761169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.761666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] PATH_INFO: `/v3/projects/f327c36627364a91a56bbf1cda21bf34` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.768785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f327c36627364a91a56bbf1cda21bf34)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.770869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.779929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767544d-8a69-4dab-8592-9e2be99cfb8a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:13.787398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:13.788834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.789816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.790404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.791801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:13.864611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:13.880295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f327c36627364a91a56bbf1cda21bf34', 'request_id': 'req-dc928c39-88ec-45b1-8870-4a3e0bd93597'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:13.900563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f327c36627364a91a56bbf1cda21bf34', 'request_id': 'req-dc928c39-88ec-45b1-8870-4a3e0bd93597'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:13.915167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f327c36627364a91a56bbf1cda21bf34', 'request_id': 'req-dc928c39-88ec-45b1-8870-4a3e0bd93597'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:13.959341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:13.967901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] The token cache is being invalidate because project f327c36627364a91a56bbf1cda21bf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:13.969050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:13.972925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:13.981107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 905/1820] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:13 2022] DELETE /identity/v3/projects/f327c36627364a91a56bbf1cda21bf34 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:13.982013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.001749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.006973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:14.061455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 916/1821] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:13 2022] POST /identity/v3/projects => generated 385 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:14.064548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.068845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.189102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928c39-88ec-45b1-8870-4a3e0bd93597 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.280184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1dcc7-d929-4e90-ad21-532788c7c864 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.303292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.304094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.304537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.304897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.305679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.315050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.316298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.318603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.323680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.324386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] PATH_INFO: `/v3/users/6b65ce1057614e6e8f8361988b117a66` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.326261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b65ce1057614e6e8f8361988b117a66)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.328638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.376856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 917/1822] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:14 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:14.379149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.396082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.423211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ced0e-c30f-429f-9253-b7b090db2f80 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.428843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.429695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.430049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.430475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] PATH_INFO: `/v3/projects/e0a49b0e8d0a4b0eb960ec300d474d46` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.431729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a49b0e8d0a4b0eb960ec300d474d46)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.434201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.452873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b65ce1057614e6e8f8361988b117a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.493407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b65ce1057614e6e8f8361988b117a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.496175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b65ce1057614e6e8f8361988b117a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.500127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b65ce1057614e6e8f8361988b117a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.520099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b65ce1057614e6e8f8361988b117a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.591649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 906/1823] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:13 2022] DELETE /identity/v3/users/6b65ce1057614e6e8f8361988b117a66 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:14.594075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.596241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a49b0e8d0a4b0eb960ec300d474d46', 'request_id': 'req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.597249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.618572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a49b0e8d0a4b0eb960ec300d474d46', 'request_id': 'req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.643642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a49b0e8d0a4b0eb960ec300d474d46', 'request_id': 'req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.683069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] The token cache is being invalidate because project e0a49b0e8d0a4b0eb960ec300d474d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:14.683376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.684118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:14.685850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:14.686592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 918/1824] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:14 2022] DELETE /identity/v3/projects/e0a49b0e8d0a4b0eb960ec300d474d46 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:14.696806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.706028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.806837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae306e-4fb8-4d9c-8d81-d3fb1f856599 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.834518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.835171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.835457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.835736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.836401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.838073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.876400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 907/1825] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:14.880790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.884610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.934296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb659c-5128-4f22-99ff-ea53085924ca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.937871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68ce9-8ef3-477f-99f4-2dd6a17cc19c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.947674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.949154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.949747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.950488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] PATH_INFO: `/v3/users/055553ee40754922b854cf4001891605` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.951916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055553ee40754922b854cf4001891605)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.955504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.956663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.957309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.957706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.959778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] PATH_INFO: `/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94/users/506f695783ad4ea39492567b0b321c2a/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.986068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:14.991430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b100d4781ea94c4b9dd8e95a4a4fcc94, user_id=506f695783ad4ea39492567b0b321c2a, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.994218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:15.027334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 908/1826] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:14 2022] PUT /identity/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94/users/506f695783ad4ea39492567b0b321c2a/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:15.031691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.085490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055553ee40754922b854cf4001891605'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:15.104468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055553ee40754922b854cf4001891605'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:15.105905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055553ee40754922b854cf4001891605'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:15.122374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055553ee40754922b854cf4001891605'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:15.159957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055553ee40754922b854cf4001891605'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:15.180962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 919/1827] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:14 2022] DELETE /identity/v3/users/055553ee40754922b854cf4001891605 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:15.221943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472dd24-e091-4ba7-9a69-080b9afdef68 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:15.373434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:15.374305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:15.376058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:15.377454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:15.378712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:15.383249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e69c84-f110-4387-9443-151f40de79a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:15.411346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 909/1828] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:15.416346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.418732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.450200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622945b2-01db-47cd-9a63-bc0ba1376083 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:15.464715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:15.466476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:15.468029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:15.468347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] PATH_INFO: `/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94/users/506f695783ad4ea39492567b0b321c2a/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:15.471883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b100d4781ea94c4b9dd8e95a4a4fcc94, user_id=506f695783ad4ea39492567b0b321c2a, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:15.480404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:15.523149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 920/1829] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:15 2022] PUT /identity/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94/users/506f695783ad4ea39492567b0b321c2a/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:15.524875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:15.525431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:15.525431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:15.583500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] MFA Rules not processed for user `506f695783ad4ea39492567b0b321c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:15.590146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.707884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:15.725942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.728776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.852558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 910/1830] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:15.867784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.870271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.981560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26cd7-4de6-4968-bf40-7e6134a5ede2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.005917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.006694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.007251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.007653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] PATH_INFO: `/v3/projects/fbe425c9317a4132a575652346a6096f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.033734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe425c9317a4132a575652346a6096f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.033734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.061702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723215c9-7d67-4eb7-9faf-5491f823d68f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.074656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.076953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.078146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.078900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.128529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.130571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.150720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 911/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:16.164589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe425c9317a4132a575652346a6096f', 'request_id': 'req-30232135-3606-4cb9-93c8-a07b55fd9a0a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.178213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe425c9317a4132a575652346a6096f', 'request_id': 'req-30232135-3606-4cb9-93c8-a07b55fd9a0a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.194567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe425c9317a4132a575652346a6096f', 'request_id': 'req-30232135-3606-4cb9-93c8-a07b55fd9a0a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.235877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] The token cache is being invalidate because project fbe425c9317a4132a575652346a6096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:16.236563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.240354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.242514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 921/1832] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:15 2022] DELETE /identity/v3/projects/fbe425c9317a4132a575652346a6096f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:16.248208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:16.271844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4c12-a826-4687-a07c-6cd22522ab85 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.478010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.478794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.479120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.479527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] PATH_INFO: `/v3/users/b5e5c83e4779407ca5e9a8c89501e869` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.481004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e5c83e4779407ca5e9a8c89501e869)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.483091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.577458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e5c83e4779407ca5e9a8c89501e869'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.595027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e5c83e4779407ca5e9a8c89501e869'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.596643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e5c83e4779407ca5e9a8c89501e869'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.597380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e5c83e4779407ca5e9a8c89501e869'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.615272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e5c83e4779407ca5e9a8c89501e869'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.633425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:16.671487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 912/1833] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:16 2022] DELETE /identity/v3/users/b5e5c83e4779407ca5e9a8c89501e869 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:17.244397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.247246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.267546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232135-3606-4cb9-93c8-a07b55fd9a0a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.284117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:17.391146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.392099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.392524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.392943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] PATH_INFO: `/v3/users/e0fd0d7bc2f148cdb637d90afa9bd562` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.394369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fd0d7bc2f148cdb637d90afa9bd562)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.396500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.433827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.435408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.466468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aff31-ad1b-4f96-9292-b753ea4d8442 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.478919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.480369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.480997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.484645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] PATH_INFO: `/v3/users/f14653dab8b942c8b127bf7d729288c0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.486509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14653dab8b942c8b127bf7d729288c0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.490137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.538826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fd0d7bc2f148cdb637d90afa9bd562'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.554910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fd0d7bc2f148cdb637d90afa9bd562'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.555766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fd0d7bc2f148cdb637d90afa9bd562'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.570408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fd0d7bc2f148cdb637d90afa9bd562'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.575444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14653dab8b942c8b127bf7d729288c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.596057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14653dab8b942c8b127bf7d729288c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.597378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14653dab8b942c8b127bf7d729288c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.598596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14653dab8b942c8b127bf7d729288c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.613008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fd0d7bc2f148cdb637d90afa9bd562'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.619204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccf8a259-2ab5-472c-a7d5-7072292b6222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14653dab8b942c8b127bf7d729288c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.628618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 922/1834] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:17 2022] DELETE /identity/v3/users/e0fd0d7bc2f148cdb637d90afa9bd562 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:17.629863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.632956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.697559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 913/1835] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:17 2022] DELETE /identity/v3/users/f14653dab8b942c8b127bf7d729288c0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:17.697559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30d0d5-9c19-484f-968f-8205e400f355 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.697559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30d0d5-9c19-484f-968f-8205e400f355 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.697559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30d0d5-9c19-484f-968f-8205e400f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.766212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c30d0d5-9c19-484f-968f-8205e400f355 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:17.777819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c30d0d5-9c19-484f-968f-8205e400f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.872633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6009b-1ba0-4a46-9937-8ca420b43ebd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.985118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:18.009588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 914/1836] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.011473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.011782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.012105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.052111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.053584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.053888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.054127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] PATH_INFO: `/v3/projects/35b2af81a12d400f8ee141dc99edd7ee` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.057752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b2af81a12d400f8ee141dc99edd7ee)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.064806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.068979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.073452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.104771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 915/1837] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.106249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.108790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.198315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b2af81a12d400f8ee141dc99edd7ee', 'request_id': 'req-e2d378e8-476a-484c-a7b6-183c5f8ef967'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.216211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b2af81a12d400f8ee141dc99edd7ee', 'request_id': 'req-e2d378e8-476a-484c-a7b6-183c5f8ef967'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.225996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b2af81a12d400f8ee141dc99edd7ee', 'request_id': 'req-e2d378e8-476a-484c-a7b6-183c5f8ef967'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.253785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] The token cache is being invalidate because project 35b2af81a12d400f8ee141dc99edd7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:18.256266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.257888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.261942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 923/1838] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:17 2022] DELETE /identity/v3/projects/35b2af81a12d400f8ee141dc99edd7ee => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:18.268929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.273791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.277152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb3f6-9656-47a9-9f01-0845a603d947 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.300904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:18.392335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.393645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.393962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.394367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.398981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.434431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d378e8-476a-484c-a7b6-183c5f8ef967 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.444753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.445399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.445708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.446731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.455392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.501963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.504211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc1a9-21df-41b9-b7ad-37e719f012a3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.528592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 916/1839] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:18.530067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbafe-324c-4e7d-acf9-92b6cca61245 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.534173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbafe-324c-4e7d-acf9-92b6cca61245 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.535537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbafe-324c-4e7d-acf9-92b6cca61245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.598336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.600010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.600743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-652cbafe-324c-4e7d-acf9-92b6cca61245 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.603689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-652cbafe-324c-4e7d-acf9-92b6cca61245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.622166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 924/1840] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:18.623223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.635147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.647659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 917/1841] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.649361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09e95-eea5-4061-b8dc-431bc9dae1f3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.650490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09e95-eea5-4061-b8dc-431bc9dae1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.650490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09e95-eea5-4061-b8dc-431bc9dae1f3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.662365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 918/1842] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:12:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:12:18.662850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0568b-a1af-4515-97b2-6c01752fff79 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.664833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.665369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.665946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.679159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.679820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.680162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.680420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] PATH_INFO: `/v3/projects/c4f4317e3e724db09128d8b1e5856cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.681706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f4317e3e724db09128d8b1e5856cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.684207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.711020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.712800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:18.712933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.747033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 919/1843] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.751092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.766333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e8946-d680-4d71-99b6-5fefe33e16a6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.774351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.775398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.776034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.777130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.778310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:18.778887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.781167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eda99-1139-48b4-9d48-f58b46c445e2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.799933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 920/1844] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:12:18.802246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2faead-4ea4-4756-b342-2eb4c8a7e872 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.802911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2faead-4ea4-4756-b342-2eb4c8a7e872 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.803412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2faead-4ea4-4756-b342-2eb4c8a7e872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.833314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8f2faead-4ea4-4756-b342-2eb4c8a7e872 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.835039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f2faead-4ea4-4756-b342-2eb4c8a7e872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.836342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f4317e3e724db09128d8b1e5856cc1', 'request_id': 'req-bf956f90-30b6-450f-aa69-3ab085966945'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.864006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f4317e3e724db09128d8b1e5856cc1', 'request_id': 'req-bf956f90-30b6-450f-aa69-3ab085966945'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.883991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f4317e3e724db09128d8b1e5856cc1', 'request_id': 'req-bf956f90-30b6-450f-aa69-3ab085966945'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.915482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] The token cache is being invalidate because project c4f4317e3e724db09128d8b1e5856cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:18.915885 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.917681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:18.920848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 925/1845] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:18 2022] DELETE /identity/v3/projects/c4f4317e3e724db09128d8b1e5856cc1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:18.928957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.933525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.951498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 921/1846] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.954068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eca52c-54f4-4027-8823-e39c2baa619f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.954601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eca52c-54f4-4027-8823-e39c2baa619f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.955141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eca52c-54f4-4027-8823-e39c2baa619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.985568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-22eca52c-54f4-4027-8823-e39c2baa619f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.987508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22eca52c-54f4-4027-8823-e39c2baa619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.038838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:19.088076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956f90-30b6-450f-aa69-3ab085966945 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.102331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.103214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.103612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.103978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.104770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.107095 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.144391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 922/1847] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:19.154173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.154832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.155347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.202016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 926/1848] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:19.204078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.217197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:19.219338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.393830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf479-95f0-4772-866f-5925af1e270d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.403268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 923/1849] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:19.412646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.419044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.419305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.419568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.420541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.421358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.434747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3427dd-4899-4375-b291-308ff4830521 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.435778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.445267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.445817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.446114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.446378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.447062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:19.447366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.449782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.474630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 927/1850] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:19 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:19.476270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.502616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 924/1851] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:19.502616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.508589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613263e9-312a-49f8-9ee3-254ec64afe09 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.510763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.517881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.518915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.519460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.519851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.530511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.533556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.569915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 928/1852] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:19.569915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.579951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:19.605960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51887073-6177-4d2f-89ce-57f97cb066bc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.637165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.639515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.640660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.642517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.644647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.660536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.823453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 929/1853] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:19 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:19.825030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.868453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b8e4-5ba1-45c7-bbda-a20a4a06d00c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.048141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.060183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca4e67-0abb-40ff-aafb-cf79e3d871bf admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.081303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.085067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.085458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.085799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.086651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.091636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.099418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.100116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.100521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.100884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.138007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 930/1854] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:20.139589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.141021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.143373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.145194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.171227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df28b2-3d39-40b1-8db9-c50da30238b5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.174101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 925/1855] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:20.175484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.178082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.179039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.179394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.179688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] PATH_INFO: `/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.181150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f43a5c4f5e34593a34d1fbf72d01922)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.183841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.200515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e70b0c-ef6c-4a90-8892-0990390cbe1e service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.216012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.216855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.217630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.218124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.219093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.221778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.255344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 926/1856] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:20.256507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.260995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f43a5c4f5e34593a34d1fbf72d01922', 'request_id': 'req-b5f07785-8133-4bc1-b5ce-4994b2f80cac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.269800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f43a5c4f5e34593a34d1fbf72d01922', 'request_id': 'req-b5f07785-8133-4bc1-b5ce-4994b2f80cac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.270370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307ae8-5ed4-4b68-8457-88bde08f6781 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.280064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f43a5c4f5e34593a34d1fbf72d01922', 'request_id': 'req-b5f07785-8133-4bc1-b5ce-4994b2f80cac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.312966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] The token cache is being invalidate because project 2f43a5c4f5e34593a34d1fbf72d01922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:20.313262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.314001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.315513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 931/1857] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/projects/2f43a5c4f5e34593a34d1fbf72d01922 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.316367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.317723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.356887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.357674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.358067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.358539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] PATH_INFO: `/v3/projects/2e2417e251fa4d4bb6400891f2383739/users/da8cf566be6a483d82309f796f8fac64/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.397568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2417e251fa4d4bb6400891f2383739, user_id=da8cf566be6a483d82309f796f8fac64, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.401712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c50aa5-506b-4d09-93dc-226aeed03020 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.421832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07785-8133-4bc1-b5ce-4994b2f80cac admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.426642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 927/1858] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:20 2022] PUT /identity/v3/projects/2e2417e251fa4d4bb6400891f2383739/users/da8cf566be6a483d82309f796f8fac64/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.427938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.428224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.428495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.441037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.476598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:20.477976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.530919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.531851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.533761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.534075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.536153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.537863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.551070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 932/1859] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:20.552076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.556719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.578899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 928/1860] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.585700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bdc-9436-4e20-b28f-5d37493f485b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.585787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.585787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.591633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.592391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.594040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.594467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] PATH_INFO: `/v3/projects/87e6debc781d4b11bac43bbd06fef09b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.598683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e6debc781d4b11bac43bbd06fef09b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.601050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.612192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f489da-9158-48cf-9c62-75a1e1f56303 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.621374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.622932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.623402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.624136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] PATH_INFO: `/v3/projects/6058bbaca4f64d33a62148fb82b930a7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.625657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6058bbaca4f64d33a62148fb82b930a7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.629306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.664277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e6debc781d4b11bac43bbd06fef09b', 'request_id': 'req-43ad2029-7419-4e76-9876-9f80bee87c95'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.674177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e6debc781d4b11bac43bbd06fef09b', 'request_id': 'req-43ad2029-7419-4e76-9876-9f80bee87c95'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.687211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e6debc781d4b11bac43bbd06fef09b', 'request_id': 'req-43ad2029-7419-4e76-9876-9f80bee87c95'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.695464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.708954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] The token cache is being invalidate because project 87e6debc781d4b11bac43bbd06fef09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:20.710684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.711641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6058bbaca4f64d33a62148fb82b930a7', 'request_id': 'req-619c6b28-cb6f-40ac-827f-0cd88c7710a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.712472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-43ad2029-7419-4e76-9876-9f80bee87c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.715314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 933/1861] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/projects/87e6debc781d4b11bac43bbd06fef09b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.716777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f0b8-f288-42b3-b963-f0ec45c5c8a8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.717265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f0b8-f288-42b3-b963-f0ec45c5c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.718274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f0b8-f288-42b3-b963-f0ec45c5c8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.724284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6058bbaca4f64d33a62148fb82b930a7', 'request_id': 'req-619c6b28-cb6f-40ac-827f-0cd88c7710a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.732977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6058bbaca4f64d33a62148fb82b930a7', 'request_id': 'req-619c6b28-cb6f-40ac-827f-0cd88c7710a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.761694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c358f0b8-f288-42b3-b963-f0ec45c5c8a8 None None] MFA Rules not processed for user `da8cf566be6a483d82309f796f8fac64`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:20.761853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] The token cache is being invalidate because project 6058bbaca4f64d33a62148fb82b930a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:20.761853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.762029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c358f0b8-f288-42b3-b963-f0ec45c5c8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.762121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.762121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 929/1862] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/projects/6058bbaca4f64d33a62148fb82b930a7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.762121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.762121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.828024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6b28-cb6f-40ac-827f-0cd88c7710a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.829655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 934/1863] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.830903 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.831190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.831465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.834862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.835477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.835759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.836031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.836669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.838875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.852717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 930/1864] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:20.852717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.852985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:20.852985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.853158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.860930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 935/1865] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.861804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.863080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.868172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b256c4-569d-45e3-a3c0-64b099337707 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.873119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.873897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.874186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.874518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] PATH_INFO: `/v3/users/e2d4f29115f64d76b20185d9816f18ae` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.875112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673270c-c5a0-4d70-bd8b-ae0df7643447 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.875704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d4f29115f64d76b20185d9816f18ae)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.877734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.879706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.880322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.880603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.880873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] PATH_INFO: `/v3/users/506f695783ad4ea39492567b0b321c2a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.882028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506f695783ad4ea39492567b0b321c2a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.883927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.886925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.933679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d4f29115f64d76b20185d9816f18ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.938483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506f695783ad4ea39492567b0b321c2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.944337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d4f29115f64d76b20185d9816f18ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.945081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d4f29115f64d76b20185d9816f18ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.945874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d4f29115f64d76b20185d9816f18ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.947958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506f695783ad4ea39492567b0b321c2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.949076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506f695783ad4ea39492567b0b321c2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.958898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d4f29115f64d76b20185d9816f18ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.959107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506f695783ad4ea39492567b0b321c2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.977280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506f695783ad4ea39492567b0b321c2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.983583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 931/1866] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/users/e2d4f29115f64d76b20185d9816f18ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.984196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.985775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.990206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 936/1867] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/users/506f695783ad4ea39492567b0b321c2a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.991179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.992796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.042855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.091584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358162-bce5-4347-b72b-e9f2b1444e94 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.103505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.105150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.105832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.106592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.108558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.111392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.124624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f6197-82cf-40b6-a907-fe0be3586106 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.143549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.144457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.144813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.145162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] PATH_INFO: `/v3/projects/accff58f3c21468e840d57f945f7755f/users/7b01713d6761423c8df3e2b15f90c68d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.164617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accff58f3c21468e840d57f945f7755f, user_id=7b01713d6761423c8df3e2b15f90c68d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.168561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 932/1868] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.169421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.171252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.172090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.189445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 937/1869] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:20 2022] PUT /identity/v3/projects/accff58f3c21468e840d57f945f7755f/users/7b01713d6761423c8df3e2b15f90c68d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:21.190215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.192083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.244164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8340b-9625-4454-a0c5-b821d21b196c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.277301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13f2e-75ec-4bf7-929a-d59d84142f07 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.284539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.286427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.286939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.287673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.288484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.295406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f158e-f335-4ab6-a253-1b44d1ce260a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.309013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.324611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.325391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.325875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.326314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 938/1870] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.326432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.327334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.327642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.327740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:21.327922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.328221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.330155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.345595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 933/1871] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:21.345595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.356638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f701f3-6fba-49f0-8f99-b03ca295b177 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.361989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.362362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] MFA Rules not processed for user `7b01713d6761423c8df3e2b15f90c68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:21.362810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.363509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.363509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.363714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.364374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.366098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.377491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 934/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.378264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.392755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ce0a-681a-44c2-a2dd-790c9f8f942e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.403070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.403689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.403974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.404247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.404886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.406838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.441309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 935/1873] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.441309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.446547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 939/1874] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:21.447485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.461467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a0cf-f4a3-4be4-b1b2-566764b5d711 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.487040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.537078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6d11-cbca-472e-adb6-08c6d9715205 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.545923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.547361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.547361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.547719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] PATH_INFO: `/v3/projects/90a72019274a42f8b095fe3131edc4ff/users/98153c5362b14b51878540e88e3b2d50/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.568146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a72019274a42f8b095fe3131edc4ff, user_id=98153c5362b14b51878540e88e3b2d50, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.568997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.569752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.570104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.570439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.571230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.572314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.573736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.592626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 936/1875] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:21 2022] PUT /identity/v3/projects/90a72019274a42f8b095fe3131edc4ff/users/98153c5362b14b51878540e88e3b2d50/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:21.594179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.603464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 940/1876] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.604486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.610172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.631093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69387-39b7-4673-b1d5-5ea95e0250ca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.683277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5c1ff-193d-4fb6-b309-0d641d7546f9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.688390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.689082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.689362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.689680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.690312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.692343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.692743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.693439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.693833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.694204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] PATH_INFO: `/v3/projects/b2a5a654be6f4e6f9eaeca0699963090` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.695417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a5a654be6f4e6f9eaeca0699963090)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.697418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.719475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.739529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 937/1877] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.740415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.742110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.763094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a5a654be6f4e6f9eaeca0699963090', 'request_id': 'req-defba156-edc5-4dc7-ad36-7b0219d727b7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.772296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a5a654be6f4e6f9eaeca0699963090', 'request_id': 'req-defba156-edc5-4dc7-ad36-7b0219d727b7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.781398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a5a654be6f4e6f9eaeca0699963090', 'request_id': 'req-defba156-edc5-4dc7-ad36-7b0219d727b7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.798822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] The token cache is being invalidate because project b2a5a654be6f4e6f9eaeca0699963090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:21.799274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.800089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.805609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 941/1878] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:21 2022] DELETE /identity/v3/projects/b2a5a654be6f4e6f9eaeca0699963090 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:21.808478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.811691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.820814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f36c44-cc79-4f1c-b783-295c947da06b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.870841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.889696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.890350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.890633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.891234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] PATH_INFO: `/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.892035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b100d4781ea94c4b9dd8e95a4a4fcc94)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.894054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.894175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba156-edc5-4dc7-ad36-7b0219d727b7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.900299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.901292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.901752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.902127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.902887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.904643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.919127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 942/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.919127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.920768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.937943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80110f6-e0b3-4286-9b11-b82e2e664650 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.949367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b100d4781ea94c4b9dd8e95a4a4fcc94', 'request_id': 'req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.956451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b100d4781ea94c4b9dd8e95a4a4fcc94', 'request_id': 'req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.964371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b100d4781ea94c4b9dd8e95a4a4fcc94', 'request_id': 'req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.988451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] The token cache is being invalidate because project b100d4781ea94c4b9dd8e95a4a4fcc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:21.988451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.988451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.988451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 938/1880] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:21 2022] DELETE /identity/v3/projects/b100d4781ea94c4b9dd8e95a4a4fcc94 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:21.988451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.988881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.001051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.001711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.002000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.002267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.002916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.004530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d347d86-c880-4391-8a6f-aa60cfb5ec9a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.015143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 943/1881] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.016337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.016623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.016896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.036459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.037692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.045784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 944/1882] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.046550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.047783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.056831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7fa0-d49c-4e00-8ce8-6df8725dfb85 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.059438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fae8d-fc22-437a-ba0f-694c11e6be77 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.062187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.062797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.063074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.063343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.063966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.064080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.064614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.064895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.065168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] PATH_INFO: `/v3/projects/90a72019274a42f8b095fe3131edc4ff/users/98153c5362b14b51878540e88e3b2d50/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.065938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.067092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a72019274a42f8b095fe3131edc4ff, user_id=98153c5362b14b51878540e88e3b2d50, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.069738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255e078-a24f-47e1-81e7-5e518d598211 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.080907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 945/1883] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/90a72019274a42f8b095fe3131edc4ff/users/98153c5362b14b51878540e88e3b2d50/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:22.082130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f803-8d47-477d-984b-00eb21a23f1a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.082416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f803-8d47-477d-984b-00eb21a23f1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.082687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f803-8d47-477d-984b-00eb21a23f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.099516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 939/1884] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.100671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.102602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.108091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2c71f803-8d47-477d-984b-00eb21a23f1a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.109306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c71f803-8d47-477d-984b-00eb21a23f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.115939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5af6d-1ea7-487c-a818-c0fb6755b7a1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.118916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.185264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 946/1885] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.185264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.185264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.185264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.187546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.188254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.188558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.188919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.189680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.191629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9076e-4ea7-469c-826c-bba9fc8f7546 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.200210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.204050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.205338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.207272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 940/1886] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.208661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.209499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.210640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.215020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 947/1887] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.216043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.226518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb95a69-db01-4140-bb0c-bc9e59688f53 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.236653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.238570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.239597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.240029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.240894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.242559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e87fd9-1c67-4ce9-ab11-bbb662ada3a9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.249910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] MFA Rules not processed for user `98153c5362b14b51878540e88e3b2d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.251333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.258815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 948/1888] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.260302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.260630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.261100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.292009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.293239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.303378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 949/1889] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.308316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.319867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e02318-6598-43fc-8664-f400f7398666 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.325425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.326122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.326401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.326672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] PATH_INFO: `/v3/projects/acb05a2e3770457a8d71403f8129d2d7/users/ee9e6856a3ce4b519f95367074383197/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.339955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 941/1890] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.339955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.344876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6e8ec-af6a-4b81-8922-f72cec736f63 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.349643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.350246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.350884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.351017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.351577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:22.351866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.353447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.353730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb05a2e3770457a8d71403f8129d2d7, user_id=ee9e6856a3ce4b519f95367074383197, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.357393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.366500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 942/1891] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:22.367282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.371087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 950/1892] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/acb05a2e3770457a8d71403f8129d2d7/users/ee9e6856a3ce4b519f95367074383197/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:22.372153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.378046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54d84-d425-46e5-ad18-9a95211d9c7d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.435663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.436234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.436516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.436790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] PATH_INFO: `/v3/projects/36b518a1ffe74757add01f4d1917a34d/users/2476bf79424d4ce9a2751596b7e206e5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.442537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad072-883b-4777-a508-fd8368d94d63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.448304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.449367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.449789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.450377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.451067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:22.451360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.451775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b518a1ffe74757add01f4d1917a34d, user_id=2476bf79424d4ce9a2751596b7e206e5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.453001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.454466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.465907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 951/1893] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:22.465907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.469974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 943/1894] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/36b518a1ffe74757add01f4d1917a34d/users/2476bf79424d4ce9a2751596b7e206e5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:22.469974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.471581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.544755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170115-fee6-4b8a-9df0-278f052327eb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.552013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.559967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8030a06-57b2-4818-aac4-fda8a5cfd794 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.567719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.568499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.568684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.569488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.569947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.570754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.573538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaff1b-57a2-4cc2-86f2-e70c40a436c3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.606782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 944/1895] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.606782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.606782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.606782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.618623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.619231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.619710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.620003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.635485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] MFA Rules not processed for user `ee9e6856a3ce4b519f95367074383197`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.636831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.681626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.683135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.693361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 952/1896] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:22.693920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.703937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 945/1897] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.704981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.705094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374eea-6720-4e30-a58b-475f316a3670 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.797829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.797829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.800960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.801313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.802112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.804124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.813077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c01fa7-9f22-45ef-8c79-5ff6929f9047 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.818033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.818756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.819110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.819456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.820172 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.821884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.837030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 946/1898] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.837030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.837271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 953/1899] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.837271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.851488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122742b3-71f9-4563-ad60-abc0097607d9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.904213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.915198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cedcd0-ff4d-434d-b36b-22693d78ba57 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.918623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.919326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.919611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.919886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.920156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.920515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.920761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.921039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.921307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.921968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.922517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.923850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.934287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.949422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 947/1900] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.949422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.958938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 954/1901] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.960279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.005102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1069-2e70-4b34-b6f7-60364b6572ec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.038594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46827a-f905-41e8-8103-885f27e539e5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.044378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.045034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.045310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.045638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] PATH_INFO: `/v3/projects/36b518a1ffe74757add01f4d1917a34d/users/2476bf79424d4ce9a2751596b7e206e5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.047753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b518a1ffe74757add01f4d1917a34d, user_id=2476bf79424d4ce9a2751596b7e206e5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.050260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.061966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.062589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.062871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.063336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.065115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.065593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 955/1902] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/36b518a1ffe74757add01f4d1917a34d/users/2476bf79424d4ce9a2751596b7e206e5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:23.066917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.135799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.137252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.146572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512034-09fd-4c9f-8b4b-f2e5b742996d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.148166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 948/1903] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:23.148901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.152534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.153371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.153741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.154213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.154950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.157062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e1737-bf21-428a-b0c9-d5ed6e0b4934 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.162705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b89e-03c2-4226-9f8d-ed7d3f235a35 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.171120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.171589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.172050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.172468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.173228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.175085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.190268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 949/1904] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:23.190268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.196298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 956/1905] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:23 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:23.197882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.198336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.198620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.199020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21afc1-7428-4818-8e11-c991a6d5aeb6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.203990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.204655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.204998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.205334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.206180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.208197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.230665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 950/1906] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:23 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:23.234477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.235464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] MFA Rules not processed for user `2476bf79424d4ce9a2751596b7e206e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:23.236951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.246174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658ba5-26ce-4b3a-8a31-8a586f348691 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.250871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.251505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.251786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.252076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.252701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.254321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.265945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 951/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:23.266591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.277440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0d7a-f362-4991-b808-bd47d87de90a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.283338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.283642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.283935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.284191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.284832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.286457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.291901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:23.298467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 952/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:23.300100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.311248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6197a-8ddb-4a60-94d3-270ad97c4d50 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.315918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.316630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.316918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.317194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.318078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.319683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.321351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 957/1909] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:23.326810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.360531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dab5d-f60d-4c90-8f5c-488f7b3212c7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.362458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 953/1910] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:23.364046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.372894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.373691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.374106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.374454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] PATH_INFO: `/v3/projects/67160367fe79403bbbcf645bbed4b5ed/users/33b74fa4c7b241c188f3fb84cc62fed8/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.381047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:23.391189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9e428-2261-41de-9664-9452902b28b8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.404607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.407782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.408027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.408826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.409042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.411544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.417061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67160367fe79403bbbcf645bbed4b5ed, user_id=33b74fa4c7b241c188f3fb84cc62fed8, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.424214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.429948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 954/1911] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:23.430876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.434960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.442948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 958/1912] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:23 2022] PUT /identity/v3/projects/67160367fe79403bbbcf645bbed4b5ed/users/33b74fa4c7b241c188f3fb84cc62fed8/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:23.444139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.536665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571c40b-9c90-434a-872c-adf207150694 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.591611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629caff-dafb-4e7b-9eba-63c040e6a79c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.606674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.607129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.607419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.607697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] PATH_INFO: `/v3/projects/83dd1684283e499ca7dd647507f52a2c/users/22354b5dec304fecb80ef8b46126a7a3/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.642248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dd1684283e499ca7dd647507f52a2c, user_id=22354b5dec304fecb80ef8b46126a7a3, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.645438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.653185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.653896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.654182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.654454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.676259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 959/1913] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:23 2022] PUT /identity/v3/projects/83dd1684283e499ca7dd647507f52a2c/users/22354b5dec304fecb80ef8b46126a7a3/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:23.676259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.816210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.822115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f18192-1b3e-4c99-afcb-4cf6a054d887 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.850409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 955/1914] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:23.854166 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.854316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.854605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.903120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4bdd4-9966-40f7-8ebb-2a7478e0c233 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.912678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] MFA Rules not processed for user `33b74fa4c7b241c188f3fb84cc62fed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:23.918743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.921597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.924027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.924201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.926638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] PATH_INFO: `/v3/projects/0e93885d73ff48988a272135128ee5f7/users/5550848d1165400db1c2074ecc5bc4a4/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.975043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e93885d73ff48988a272135128ee5f7, user_id=5550848d1165400db1c2074ecc5bc4a4, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.981843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.004673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 960/1915] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:23 2022] PUT /identity/v3/projects/0e93885d73ff48988a272135128ee5f7/users/5550848d1165400db1c2074ecc5bc4a4/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:24.006160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.022029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:24.056565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:24.064054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 956/1916] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:24.067430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.112578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9d3ff-dfec-4182-9004-6db1737c9a91 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.136385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656111bc-1b7b-4a64-810c-d899c52696ab admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.146188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.146846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.147132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.147398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.148046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.149727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432ef8-6dda-4d69-a068-2b9f089fe98b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.165125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 961/1917] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:24.166953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.167241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.167514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.189967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.190633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.190909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.191205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] PATH_INFO: `/v3/users/7b01713d6761423c8df3e2b15f90c68d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.192376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b01713d6761423c8df3e2b15f90c68d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.194718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.209638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] MFA Rules not processed for user `5550848d1165400db1c2074ecc5bc4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:24.211123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.260174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b01713d6761423c8df3e2b15f90c68d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.270203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b01713d6761423c8df3e2b15f90c68d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.271034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b01713d6761423c8df3e2b15f90c68d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.273436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b01713d6761423c8df3e2b15f90c68d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.283834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b01713d6761423c8df3e2b15f90c68d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.308561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 957/1918] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:24 2022] DELETE /identity/v3/users/7b01713d6761423c8df3e2b15f90c68d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:24.309477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.312239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.321686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 962/1919] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:24.321686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.321686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.346635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a340-3fd7-4241-82c2-81f3999f53a2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.412101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ccae6-5017-44cf-9812-8bf0ba081c35 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.417558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.418180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.418462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.418729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.419359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.421384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.436015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.436689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.436970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.437264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] PATH_INFO: `/v3/projects/83dd1684283e499ca7dd647507f52a2c/users/22354b5dec304fecb80ef8b46126a7a3/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.437567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:24.439321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dd1684283e499ca7dd647507f52a2c, user_id=22354b5dec304fecb80ef8b46126a7a3, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.442063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786b21-2c46-4d5d-83d1-705907fe408d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.453842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 963/1920] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:24 2022] PUT /identity/v3/projects/83dd1684283e499ca7dd647507f52a2c/users/22354b5dec304fecb80ef8b46126a7a3/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:24.454964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981770ac-e26b-4f7c-8039-f044691d6557 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.455275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981770ac-e26b-4f7c-8039-f044691d6557 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.455936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981770ac-e26b-4f7c-8039-f044691d6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.464464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 958/1921] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:24.466427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.469641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.478000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-981770ac-e26b-4f7c-8039-f044691d6557 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:24.479777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-981770ac-e26b-4f7c-8039-f044691d6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.528462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:24.540613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab307da-c608-4833-81a4-56d15b70c4ea admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.545348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 964/1922] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:24.545527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.546192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.546473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.546744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.546834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.547159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.547492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.575943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] MFA Rules not processed for user `22354b5dec304fecb80ef8b46126a7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:24.577099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.605779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.607472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.616830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 959/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:24.617642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.630327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d3516-af51-4ac7-9bd9-d06ffdef8ca1 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.639168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.640094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.640448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.640787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.641727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.643729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.661393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 965/1924] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:24.667160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.670211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.672552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 960/1925] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:24.673586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.675417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.691665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3e731-336f-4140-91be-4b1012ee0361 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.696513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.697178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.698037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.698335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] PATH_INFO: `/v3/users/5550848d1165400db1c2074ecc5bc4a4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.699507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5550848d1165400db1c2074ecc5bc4a4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.701457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.735466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5f909-1339-417b-8609-8b63400728d6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.740387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.741002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.741284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.741616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.752021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.753658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.755625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5550848d1165400db1c2074ecc5bc4a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.764032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5550848d1165400db1c2074ecc5bc4a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.764567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 966/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:24.764816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5550848d1165400db1c2074ecc5bc4a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.765449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5550848d1165400db1c2074ecc5bc4a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.765620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.774578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5550848d1165400db1c2074ecc5bc4a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:24.774830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202f50-7761-4b0e-90ea-a7593f2b0995 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.779919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.780653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.780919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.781238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.783163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.798827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.801110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a7af-9d47-46ad-9050-7dcd4b5cca95 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.805197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 961/1927] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:24 2022] DELETE /identity/v3/users/5550848d1165400db1c2074ecc5bc4a4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:24.808156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.810808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.816786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 967/1928] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:24.818084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.820244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:24.824821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.825134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.866527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:24.871170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:24.953682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67946-72e2-47dd-8ef1-998bd6134c93 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:24.968143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:24.971122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:24.973532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:24.974871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:24.977457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:24.981523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:24.986499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 968/1929] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:24.997856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:24.999522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.006783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:25.017272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 962/1930] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:25.018588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.045168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c1b7-a0e9-4bb5-870f-653e3877a745 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.060987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.062774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.063056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.063697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] PATH_INFO: `/v3/projects/2c511a926d584526b85f34bbaae0ff1e/users/1ab81f2e3d5644f88b26cd3902ed462e/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.099043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c511a926d584526b85f34bbaae0ff1e, user_id=1ab81f2e3d5644f88b26cd3902ed462e, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.102494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.129814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ad1b-1fbe-4d96-a53c-00d1eaf2ff4b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.139234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 963/1931] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:25 2022] PUT /identity/v3/projects/2c511a926d584526b85f34bbaae0ff1e/users/1ab81f2e3d5644f88b26cd3902ed462e/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:25.143746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.224370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.225278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.225606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.225874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.349304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.350840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.369001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 969/1932] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:25.421734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895170d5-7dd8-4fc0-9db6-55a10735169f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.436803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.437738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.440523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.441739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.444315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.446550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1aff-a15e-484d-860a-7e8e90de7f96 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.473036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 964/1933] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:25.477361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.489884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad7442-d7b1-4720-a51d-b24ed1b68f8b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.497557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.497801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.498133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.498417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] PATH_INFO: `/v3/projects/2c511a926d584526b85f34bbaae0ff1e/users/1ab81f2e3d5644f88b26cd3902ed462e/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.500430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c511a926d584526b85f34bbaae0ff1e, user_id=1ab81f2e3d5644f88b26cd3902ed462e, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.503249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.528078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.528370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.528652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.532646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 970/1934] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:25 2022] PUT /identity/v3/projects/2c511a926d584526b85f34bbaae0ff1e/users/1ab81f2e3d5644f88b26cd3902ed462e/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:25.576480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] MFA Rules not processed for user `1ab81f2e3d5644f88b26cd3902ed462e`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:25.578522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.635848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.638421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.732206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:25.753709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 965/1935] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:25.757810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:25.762414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330c1b-0e75-4b6e-86de-ed63d074ba62 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.766089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.768241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.770485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.771338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.771686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.772037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] PATH_INFO: `/v3/users/ee9e6856a3ce4b519f95367074383197` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.773329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9e6856a3ce4b519f95367074383197)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.776810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.847924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9e6856a3ce4b519f95367074383197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.854788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47013-ef54-4a92-afab-e228efc2395e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.858846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.859611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.859996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.860490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.862061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9e6856a3ce4b519f95367074383197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.864062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9e6856a3ce4b519f95367074383197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.866840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.880185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9e6856a3ce4b519f95367074383197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.891067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.892781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd2d0-601c-473d-a635-5a3dad2fb9e3 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.907947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 966/1936] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:25.908584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9e6856a3ce4b519f95367074383197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.920404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.920716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.920993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.939104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 971/1937] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:25 2022] DELETE /identity/v3/users/ee9e6856a3ce4b519f95367074383197 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:25.981463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:25.981463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.085267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 967/1938] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:26.110444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.116833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.226612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.228964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.233741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c99d6-5a4a-4bcb-afa7-82c5e6956d58 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.240256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.241163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.242099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.242395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.254355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165fd8-74f0-4cba-9bc2-f16eda0e7444 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.259061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.261749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066b65-80aa-48a5-939a-5d8d56b01665 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.264194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.264946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.265308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.265684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] PATH_INFO: `/v3/projects/accff58f3c21468e840d57f945f7755f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.271875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accff58f3c21468e840d57f945f7755f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.274556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.287880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 972/1939] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:26.300970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11695-25b0-4e08-b782-65154b626ed0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.301269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11695-25b0-4e08-b782-65154b626ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.301622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11695-25b0-4e08-b782-65154b626ed0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.303179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 973/1940] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:12:26.337805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.337805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.337805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.380410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:26.383434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.426601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accff58f3c21468e840d57f945f7755f', 'request_id': 'req-1385e6f5-c125-4ae8-8118-d754ed79c346'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.433801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accff58f3c21468e840d57f945f7755f', 'request_id': 'req-1385e6f5-c125-4ae8-8118-d754ed79c346'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.444097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accff58f3c21468e840d57f945f7755f', 'request_id': 'req-1385e6f5-c125-4ae8-8118-d754ed79c346'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.477053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] The token cache is being invalidate because project accff58f3c21468e840d57f945f7755f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:26.479574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.481728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.491931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 968/1941] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/projects/accff58f3c21468e840d57f945f7755f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:26.496992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.501461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.545036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 974/1942] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:26.546166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.558845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.587492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:26.617640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:26.721262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6f5-c125-4ae8-8118-d754ed79c346 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.730485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5137aa-35d7-4fb8-aa2d-f02716e60da3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.738719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.739417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.739699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.740048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] PATH_INFO: `/v3/users/2476bf79424d4ce9a2751596b7e206e5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.741213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2476bf79424d4ce9a2751596b7e206e5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.749398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.753239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.753962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.754235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.754507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] PATH_INFO: `/v3/projects/0e93885d73ff48988a272135128ee5f7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.761684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e93885d73ff48988a272135128ee5f7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.766627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.828033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2476bf79424d4ce9a2751596b7e206e5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.846548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2476bf79424d4ce9a2751596b7e206e5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.848460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2476bf79424d4ce9a2751596b7e206e5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.865297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2476bf79424d4ce9a2751596b7e206e5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.895110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2476bf79424d4ce9a2751596b7e206e5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.912686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 975/1943] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/users/2476bf79424d4ce9a2751596b7e206e5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:26.913828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.922628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.924724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e93885d73ff48988a272135128ee5f7', 'request_id': 'req-83398a99-10f9-4959-8a7e-73b5163a9b67'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.942037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e93885d73ff48988a272135128ee5f7', 'request_id': 'req-83398a99-10f9-4959-8a7e-73b5163a9b67'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.950688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e93885d73ff48988a272135128ee5f7', 'request_id': 'req-83398a99-10f9-4959-8a7e-73b5163a9b67'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.967453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] The token cache is being invalidate because project 0e93885d73ff48988a272135128ee5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:26.968306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.970109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.972119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 969/1944] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/projects/0e93885d73ff48988a272135128ee5f7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:26.973223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.975035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.104734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72ffd-70e5-4909-8591-b9d33c6ca8eb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.111860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.113103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.113381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.113813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.116262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.131139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.132836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301f0f9-a1b6-4176-b4ba-0ad3ea7d8965 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.143569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83398a99-10f9-4959-8a7e-73b5163a9b67 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.154338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 976/1945] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:27.156742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.157353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.157719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.203823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:27.206230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.234220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.313340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.314311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.314593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.314865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] PATH_INFO: `/v3/users/33b74fa4c7b241c188f3fb84cc62fed8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.319235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b74fa4c7b241c188f3fb84cc62fed8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.321975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.324892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.379534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 977/1946] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:27.380780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.384303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.412534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8235-e52a-4848-a051-bb080aec6bdb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.417668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.418391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.418742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.418915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b74fa4c7b241c188f3fb84cc62fed8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.419131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] PATH_INFO: `/v3/projects/acb05a2e3770457a8d71403f8129d2d7` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.420407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb05a2e3770457a8d71403f8129d2d7)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.428470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.429562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b74fa4c7b241c188f3fb84cc62fed8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.430596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b74fa4c7b241c188f3fb84cc62fed8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.431360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b74fa4c7b241c188f3fb84cc62fed8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.444603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9b60c07e-d549-4cc6-b6e0-6f93ae8fe04a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b74fa4c7b241c188f3fb84cc62fed8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.483286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 970/1947] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/users/33b74fa4c7b241c188f3fb84cc62fed8 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.485342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.485829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.486841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.522286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:27.523736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.526725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb05a2e3770457a8d71403f8129d2d7', 'request_id': 'req-2a64ab3f-c344-4751-8533-9ee84cf73f0e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.554275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb05a2e3770457a8d71403f8129d2d7', 'request_id': 'req-2a64ab3f-c344-4751-8533-9ee84cf73f0e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.565670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb05a2e3770457a8d71403f8129d2d7', 'request_id': 'req-2a64ab3f-c344-4751-8533-9ee84cf73f0e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.587259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] The token cache is being invalidate because project acb05a2e3770457a8d71403f8129d2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:27.587562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.589680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a64ab3f-c344-4751-8533-9ee84cf73f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.594290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 978/1948] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/projects/acb05a2e3770457a8d71403f8129d2d7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.595721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.596009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.596287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.632422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 971/1949] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:27.633842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.648852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.651242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:27.652691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.661378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 979/1950] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:27.662273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.683596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88750d26-2101-4f9c-9454-0d92d5f0ac22 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.687713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366df0b-afaa-4a76-a14d-71be6f9c964e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.696373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.699447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.699447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.699447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.699833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] PATH_INFO: `/v3/users/22354b5dec304fecb80ef8b46126a7a3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.700923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22354b5dec304fecb80ef8b46126a7a3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.704080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.705309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.705690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.705972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.706657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:27.706949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.709547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.738352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 980/1951] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:27.739328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.744442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.796688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22354b5dec304fecb80ef8b46126a7a3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.810197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22354b5dec304fecb80ef8b46126a7a3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.811304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22354b5dec304fecb80ef8b46126a7a3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.812726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22354b5dec304fecb80ef8b46126a7a3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.824809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22354b5dec304fecb80ef8b46126a7a3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.846892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.867495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 972/1952] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/users/22354b5dec304fecb80ef8b46126a7a3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.868627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.873717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.890384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82490-319b-4ae3-ab90-e8b3ee12bbbe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.967505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.002287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.003839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.004269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.004738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.008985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.086452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b45b0-834e-4d7e-b5b7-b2b3f3815020 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.101889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.102827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.103054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.103381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] PATH_INFO: `/v3/projects/36b518a1ffe74757add01f4d1917a34d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.105453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b518a1ffe74757add01f4d1917a34d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.107436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.146635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.149931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.173947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 981/1953] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:28.176243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.179651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.202990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a82d4-0222-4219-82a2-cf9a34a10bd6 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.215639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b518a1ffe74757add01f4d1917a34d', 'request_id': 'req-91e258d2-a0ee-4d9b-858c-4d69962933ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.226652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b518a1ffe74757add01f4d1917a34d', 'request_id': 'req-91e258d2-a0ee-4d9b-858c-4d69962933ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.237644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b518a1ffe74757add01f4d1917a34d', 'request_id': 'req-91e258d2-a0ee-4d9b-858c-4d69962933ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.258414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] The token cache is being invalidate because project 36b518a1ffe74757add01f4d1917a34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:28.258779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.260145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91e258d2-a0ee-4d9b-858c-4d69962933ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.266943 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 973/1954] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/projects/36b518a1ffe74757add01f4d1917a34d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.269046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba413-5018-4591-9387-f817f0c8d3ba None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.269525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba413-5018-4591-9387-f817f0c8d3ba None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.269816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba413-5018-4591-9387-f817f0c8d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.289929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.290554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.290834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.291168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.292863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.295727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.297133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-849ba413-5018-4591-9387-f817f0c8d3ba None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.298900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-849ba413-5018-4591-9387-f817f0c8d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.325664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 974/1955] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:28.332281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.332557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.332839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.350812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 982/1956] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:28.351844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.354762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.355623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.356821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.435112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 975/1957] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:28.439784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.449719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51a6f-1679-4b11-a76f-9fab7e0c69f3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.460202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd65cf2-23bb-47d3-9895-86a8ebbb09d3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.463919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.464932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.465401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.465827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.466580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.468879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.470032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.470899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.471321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.471744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.472776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:28.473885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.478034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.490312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.499819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 976/1958] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:28.500248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 983/1959] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:28.504098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.504672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.513280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.521479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa7bb3-0eab-4ab3-983c-d835c3d70281 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.523498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda57d8-8fb1-4b16-bb06-b2d48af2797e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.527784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.528257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.528538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.528846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.529452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.530666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.531412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.531531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.531737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.532016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.532861 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.538409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.553839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 977/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:28.558796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.570258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd7d91-16cc-4e95-b51a-246be08c5fca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.575835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.576462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.576794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.577077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.578066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.580023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.593876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 978/1961] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:28.594169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 984/1962] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:28.599873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.601105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.614312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9278-354f-4198-9271-84b8aebaa97b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.695083 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce84b7-0728-488b-8b5b-8543d7125df7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.701238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.702296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.703365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.703365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] PATH_INFO: `/v3/projects/92813c8fd6d64387a10c6a21a7266f52/users/e7ffda4a6415416684d53dad1ce797c6/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.725482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92813c8fd6d64387a10c6a21a7266f52, user_id=e7ffda4a6415416684d53dad1ce797c6, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.728286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.736539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.737379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.737775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.738253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.738874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.741154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.759198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 985/1963] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:28 2022] PUT /identity/v3/projects/92813c8fd6d64387a10c6a21a7266f52/users/e7ffda4a6415416684d53dad1ce797c6/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.760846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.769361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 979/1964] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:28.769932 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.770469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.772247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.797110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa564c9-91b6-4705-abe9-93b088155ffa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.872469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab300336-04ca-4354-9076-dd8f8dd5e9b2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.876652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.877023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.877314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.877637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.877763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.877950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] PATH_INFO: `/v3/projects/67160367fe79403bbbcf645bbed4b5ed` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.878053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.878286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] PATH_INFO: `/v3/projects/83dd1684283e499ca7dd647507f52a2c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.879189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=67160367fe79403bbbcf645bbed4b5ed)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.879423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dd1684283e499ca7dd647507f52a2c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.881102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.881301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.928402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dd1684283e499ca7dd647507f52a2c', 'request_id': 'req-fb4afda6-f161-4d88-8816-a925d8399311'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.929664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67160367fe79403bbbcf645bbed4b5ed', 'request_id': 'req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.934706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dd1684283e499ca7dd647507f52a2c', 'request_id': 'req-fb4afda6-f161-4d88-8816-a925d8399311'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.935917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67160367fe79403bbbcf645bbed4b5ed', 'request_id': 'req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.940700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dd1684283e499ca7dd647507f52a2c', 'request_id': 'req-fb4afda6-f161-4d88-8816-a925d8399311'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.942481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67160367fe79403bbbcf645bbed4b5ed', 'request_id': 'req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.942994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.955357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.957085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] The token cache is being invalidate because project 83dd1684283e499ca7dd647507f52a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:28.957469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.958454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb4afda6-f161-4d88-8816-a925d8399311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.959936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] The token cache is being invalidate because project 67160367fe79403bbbcf645bbed4b5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:28.960422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 986/1965] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:28 2022] DELETE /identity/v3/projects/83dd1684283e499ca7dd647507f52a2c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.960543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.961197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.961680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.962036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.962382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.966242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 980/1966] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:28 2022] DELETE /identity/v3/projects/67160367fe79403bbbcf645bbed4b5ed => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.966242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.966242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.992120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] MFA Rules not processed for user `e7ffda4a6415416684d53dad1ce797c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.993436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.037816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f8c2-f6bd-498f-8d55-221fd931d8ab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.044012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.044788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.045176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.045570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.046226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.048004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabdaa1-d66c-4966-aebc-60a9c7b6556c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.058626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 981/1967] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:29.058776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 987/1968] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.060452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.060733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.061007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.062961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.064526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.078448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd80184-8e08-413f-a6a5-00320a3fb9aa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.082526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.083037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.083662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.083943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.084101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.084201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] PATH_INFO: `/v3/users/1ab81f2e3d5644f88b26cd3902ed462e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.085328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab81f2e3d5644f88b26cd3902ed462e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.087291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.105452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 982/1969] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.109911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.126561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfb0d-e320-4a6a-9608-ccca33d8592e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.132275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.132891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.133171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.133442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.134122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.135869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.150837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 983/1970] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:29.152026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.153714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.165217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab81f2e3d5644f88b26cd3902ed462e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.174906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab81f2e3d5644f88b26cd3902ed462e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.175659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab81f2e3d5644f88b26cd3902ed462e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.186573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab81f2e3d5644f88b26cd3902ed462e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.201693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cd0c4bb0-29da-437d-88a6-4fe3063c2b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab81f2e3d5644f88b26cd3902ed462e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.213897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 988/1971] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:29 2022] DELETE /identity/v3/users/1ab81f2e3d5644f88b26cd3902ed462e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.213897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.213897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.213897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.234371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7db66-8645-4543-a766-dcc27a01d349 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.238445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.239658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.304865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.305668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.305952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.306229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.306892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.308910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.328296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 989/1972] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.329739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.332142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.360481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101e24-3d04-4be9-85dc-f1ecc6334a68 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.369733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.371383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.371807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.372181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] PATH_INFO: `/v3/projects/806ac9640165461b8df5c8ef83499ebe/users/3b5233ed0aa746309f9cbe46067f2408/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.381854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.394383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806ac9640165461b8df5c8ef83499ebe, user_id=3b5233ed0aa746309f9cbe46067f2408, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.398128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.398605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.399724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.413965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 984/1973] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:29.418776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 990/1974] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:29 2022] PUT /identity/v3/projects/806ac9640165461b8df5c8ef83499ebe/users/3b5233ed0aa746309f9cbe46067f2408/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.423672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.424421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.426205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.443312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce373c4-07fe-458e-8c79-ff1055280c4e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.512588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.513412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.513769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.514042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] PATH_INFO: `/v3/users/da8cf566be6a483d82309f796f8fac64` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.515574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8cf566be6a483d82309f796f8fac64)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.518700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.524381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de786d-5abb-40eb-b922-d6efcb092973 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.555016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.558912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.559264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.559548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.560224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:29.560533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.563390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5b6e-dcb9-4b98-a5d8-b4d0d380becc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.595543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 991/1975] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:29.597954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e60-91f1-478e-aad0-a7bc666b7f4e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.598133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e60-91f1-478e-aad0-a7bc666b7f4e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.598393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7e60-91f1-478e-aad0-a7bc666b7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.632973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-551c7e60-91f1-478e-aad0-a7bc666b7f4e None None] MFA Rules not processed for user `3b5233ed0aa746309f9cbe46067f2408`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.634406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-551c7e60-91f1-478e-aad0-a7bc666b7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.644342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8cf566be6a483d82309f796f8fac64'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.659989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8cf566be6a483d82309f796f8fac64'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.661329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8cf566be6a483d82309f796f8fac64'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.662062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8cf566be6a483d82309f796f8fac64'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.671278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8cf566be6a483d82309f796f8fac64'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.718102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 985/1976] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:29 2022] DELETE /identity/v3/users/da8cf566be6a483d82309f796f8fac64 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.724851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.727593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.734499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 992/1977] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.736454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.736751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.737028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.767999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.771572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.868305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.878731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110da0e-b54d-4e73-bf20-f5891f088147 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.895940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.897068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.898777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.899190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.900988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.905305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.932142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 993/1978] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.934245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.939047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.946795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.958234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 986/1979] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:29.960321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.965638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.976943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480ba5-2d8a-41a3-94c8-1a93d848376d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.076055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10090-b76a-4e91-80f4-d76bf367de89 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.085039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.085858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.086161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.086436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.089868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.090061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.091479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.091951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.092414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] PATH_INFO: `/v3/projects/2c511a926d584526b85f34bbaae0ff1e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.094229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c511a926d584526b85f34bbaae0ff1e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.098312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.101703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.138538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 994/1980] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.139518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.142021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.209614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c511a926d584526b85f34bbaae0ff1e', 'request_id': 'req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.225534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c511a926d584526b85f34bbaae0ff1e', 'request_id': 'req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.226406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ee525-75ec-4eb8-8599-3a6cdf24d342 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.238617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c511a926d584526b85f34bbaae0ff1e', 'request_id': 'req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.269921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] The token cache is being invalidate because project 2c511a926d584526b85f34bbaae0ff1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:30.270372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.271186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.279329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 987/1981] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:29 2022] DELETE /identity/v3/projects/2c511a926d584526b85f34bbaae0ff1e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:30.279329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.287768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.312968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.314297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.315208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.315208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.318084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.386186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e4d7-3912-4f0c-85d9-4d62258183b4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.392311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.392951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.393283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.393593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.394248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.396377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.415659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.435731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.437392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c3420-5650-419e-8fcf-32520f60e1aa service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.438991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 988/1982] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.440728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.442100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.448793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 995/1983] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:30.449944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.450229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.450503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.456914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299457f-15bd-40dc-a4c9-0c8623682b27 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.463751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.464076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.464440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.464730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.465437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.467504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae15ef-2e4b-4e45-bdfa-a638109bb20c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.472554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:30.473813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.482923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=8,keystone:SELECT=85,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.483285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 996/1984] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.484072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.497310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69da4d0-506e-42b8-b9fd-f13f1ea626b7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.503928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 989/1985] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.504227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.504863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.505145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.505592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.506319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.508279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.508688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.509098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.509695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.523554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 997/1986] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.524431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.536190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:30.536882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9f2f-b14d-4782-9e13-806f628cb8ed admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.537973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.543236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.543950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.544272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.544621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.545277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.547490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.549661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 990/1987] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.551056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.563815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2531-687d-4bc3-8528-6f72f0748936 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.569025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 998/1988] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.569163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.569810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.570404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.570563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.570836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.571602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.573640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.586650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1761c7b-5b8c-4fe2-bd95-abb1b0c74f62 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.587101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 991/1989] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.589192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.595890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.597036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.597530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.598008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.599134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:30.599481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.602250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.606564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862f54-9d6d-464b-b7c4-d873671708c6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.614405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.615294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.615797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.616318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.617297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.619178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.621391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 999/1990] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:30.622551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.634065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 992/1991] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.635719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.637832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637590b-4458-4bff-a6c3-9352e2f90fcd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.643833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.644337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.644693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.645041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] PATH_INFO: `/v3/projects/6c153e8e0e2546d58d829e8c4f6c2880/users/fc6ced66eb1a44e8aa482fc0e1d2c0b5/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.652582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d731af-fb91-44d4-9fd6-9777ba04d71b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.660595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.661478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.662145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.662583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.663370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.665474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c153e8e0e2546d58d829e8c4f6c2880, user_id=fc6ced66eb1a44e8aa482fc0e1d2c0b5, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.665753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9879bec-136b-487e-8591-9b70c9e117f3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.669274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.697666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1000/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:30 2022] PUT /identity/v3/projects/6c153e8e0e2546d58d829e8c4f6c2880/users/fc6ced66eb1a44e8aa482fc0e1d2c0b5/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:30.699728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.716642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 993/1993] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.718636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.720251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.720757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.758582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] MFA Rules not processed for user `fc6ced66eb1a44e8aa482fc0e1d2c0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:30.760438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.786183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a22649-7451-4dd6-a19b-708da187c8fa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.854136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 994/1994] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.856924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.868243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.869114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.870217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.870906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] PATH_INFO: `/v3/projects/a36fa0ca9bc34b519ed56b5bb748435c/users/60bafefd39a7405caa9326a5fd5b2954/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.901291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36fa0ca9bc34b519ed56b5bb748435c, user_id=60bafefd39a7405caa9326a5fd5b2954, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.908026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.957384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1001/1995] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:30 2022] PUT /identity/v3/projects/a36fa0ca9bc34b519ed56b5bb748435c/users/60bafefd39a7405caa9326a5fd5b2954/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:30.957384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.961381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.984206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341cb1-5cb3-4fe7-8070-6843eca1b2ae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.039694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.063893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.064531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.064814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.065091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.065779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.068540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df348-a63f-4cb7-a6f5-e513a4ccdf63 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.070277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae260-6f7c-4b20-bc83-83751c7db3cc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.078209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.079158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.079671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.080143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.080984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.083464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.108104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 995/1996] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.112977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.113472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.113767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.144276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1002/1997] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.145444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.147524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.151539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] MFA Rules not processed for user `60bafefd39a7405caa9326a5fd5b2954`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:31.153032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.265313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85e0bb-470b-4a29-b227-39138c791fd8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.265555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 996/1998] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:31.266497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.272940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.273623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.273908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.274185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] PATH_INFO: `/v3/projects/2e2417e251fa4d4bb6400891f2383739` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.275996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2417e251fa4d4bb6400891f2383739)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.278055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.279422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c74a-a3e1-4472-9d4b-718cfafc865f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.288093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.288843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.289222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.289629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.290378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.292213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.303707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 997/1999] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.305316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.316594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76fbc-3c42-4254-8489-c99fc4bdb0a8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.336433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2417e251fa4d4bb6400891f2383739', 'request_id': 'req-631d79a7-56b0-46e9-8456-2643c90b5031'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.344872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2417e251fa4d4bb6400891f2383739', 'request_id': 'req-631d79a7-56b0-46e9-8456-2643c90b5031'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.354105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2417e251fa4d4bb6400891f2383739', 'request_id': 'req-631d79a7-56b0-46e9-8456-2643c90b5031'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.373683 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] The token cache is being invalidate because project 2e2417e251fa4d4bb6400891f2383739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:31.374289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.375573 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.377451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1003/2000] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:31 2022] DELETE /identity/v3/projects/2e2417e251fa4d4bb6400891f2383739 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.378607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.380002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.385094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.385799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.386081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.386344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.387001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.388905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.396651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d79a7-56b0-46e9-8456-2643c90b5031 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.403292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.404053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.404409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.404752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.405593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.407600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.417453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 998/2001] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.417453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.417453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.428849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ffb6-86d8-4b5d-b36a-80802315c91d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.434658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.435290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.435569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.435844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.436506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.438128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.441537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1004/2002] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.442533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.445434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.450203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.453641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 999/2003] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.453641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.454664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.469576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754d47-76ed-4557-8aef-527383afb81a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.498268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.520372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa42beb-f803-403e-a668-df57a0d6b4b2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.525877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.526511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.526783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.527065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] PATH_INFO: `/v3/users/98153c5362b14b51878540e88e3b2d50` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.528194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98153c5362b14b51878540e88e3b2d50)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.530166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.531447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.532065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.532343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.532781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.533262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.535056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.546041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1000/2004] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.546831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.556862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d85c-7521-4182-9e97-3c96eec846dd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.562273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.563437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.563725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.563998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.564731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.566759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.582474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98153c5362b14b51878540e88e3b2d50'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.589298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1001/2005] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.590272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.591172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98153c5362b14b51878540e88e3b2d50'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.592140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98153c5362b14b51878540e88e3b2d50'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.600088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6e6a-fb2c-494d-9b4d-2154b4a2f563 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.600309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98153c5362b14b51878540e88e3b2d50'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.604998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.605678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.605965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.606244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] PATH_INFO: `/v3/projects/3133414a7c44427eab3946a811a7fde7/users/4f422fb6372e45f2931275cbdd14ba03/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.613073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98153c5362b14b51878540e88e3b2d50'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:31.622162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1005/2006] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:31 2022] DELETE /identity/v3/users/98153c5362b14b51878540e88e3b2d50 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.622162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.622428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3133414a7c44427eab3946a811a7fde7, user_id=4f422fb6372e45f2931275cbdd14ba03, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.622535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.623812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.641226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1002/2007] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/3133414a7c44427eab3946a811a7fde7/users/4f422fb6372e45f2931275cbdd14ba03/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.651431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.653147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.707176 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e5b7a-30d6-4470-8c08-99357eaf0ce5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.732076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675fe21-5085-4b8b-9fb7-15071aec7bef admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.737713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.738317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.738450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.738717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.739065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.739797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.741478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7208a-dda3-4f69-9259-f7207c1c71b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.754392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1003/2008] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.755587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.755876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.756155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.785294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.786025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.786360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.786671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] PATH_INFO: `/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4/users/fc1df033754b49fd8021c042550141e0/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.787599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] MFA Rules not processed for user `4f422fb6372e45f2931275cbdd14ba03`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:31.789184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.805032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82901e5681f4aa5b0fd3f076c0626b4, user_id=fc1df033754b49fd8021c042550141e0, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.807961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.824457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1006/2009] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4/users/fc1df033754b49fd8021c042550141e0/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.825654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.879337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1004/2010] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:31.880387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.892020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225539d-c937-4fdf-8fa2-34e9c472deaf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.897714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4d3c-c01e-4bb5-a640-e84ba8784080 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.897896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.898457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.898741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.899011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.899649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.902349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.903948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.904699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.905238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.905809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.905945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] PATH_INFO: `/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9/users/9559882d2dd74d27b2caffbe7fe44197/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.925337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1005/2011] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.925337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.926251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.930644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382fd903a7b54e5e8e4e15180ecbd1d9, user_id=9559882d2dd74d27b2caffbe7fe44197, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.934252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.940875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6b0e8-8604-46d4-a908-f3d2455c8e16 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.955657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1007/2012] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9/users/9559882d2dd74d27b2caffbe7fe44197/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.956762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.978519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.979354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.979645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.979931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.980596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.984446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.018222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1006/2013] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:32.019081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.020721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.050411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca349-08d8-4d31-a0a7-408d582e7bf9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.102060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.110176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755763-c67c-4eec-ba31-bbf377bee35c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.116411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.117340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.117878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.118197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] PATH_INFO: `/v3/projects/90a72019274a42f8b095fe3131edc4ff` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.119695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a72019274a42f8b095fe3131edc4ff)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.122101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.126963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.127724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.128077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.128424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] PATH_INFO: `/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4/users/fc1df033754b49fd8021c042550141e0/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.130517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82901e5681f4aa5b0fd3f076c0626b4, user_id=fc1df033754b49fd8021c042550141e0, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.133236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.153581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1008/2014] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4/users/fc1df033754b49fd8021c042550141e0/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:32.154937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.180752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a72019274a42f8b095fe3131edc4ff', 'request_id': 'req-fda9251c-c18b-4e98-946c-272cb08d2e94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.186382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a72019274a42f8b095fe3131edc4ff', 'request_id': 'req-fda9251c-c18b-4e98-946c-272cb08d2e94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.192483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a72019274a42f8b095fe3131edc4ff', 'request_id': 'req-fda9251c-c18b-4e98-946c-272cb08d2e94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.205899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] The token cache is being invalidate because project 90a72019274a42f8b095fe3131edc4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:32.206344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.207164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.208853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1007/2015] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:32 2022] DELETE /identity/v3/projects/90a72019274a42f8b095fe3131edc4ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:32.210355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.211716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.221048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2fb98-cd2f-442c-946c-b00420b5ee97 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.288709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9251c-c18b-4e98-946c-272cb08d2e94 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.295742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.296930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.297190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.297473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.298153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.300097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cfdae-9bf9-4404-97f7-592b7b2c706d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.312493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.317472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.318228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.318516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.318990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.320462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.323001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93805-4c32-4473-9672-e0533a667dcc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.336613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1008/2016] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:32.340242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.340617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.340905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.346581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1009/2017] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:32.347880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.348169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.348448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.377024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.377024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.384407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1010/2018] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:32.385823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.386503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] MFA Rules not processed for user `fc1df033754b49fd8021c042550141e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.387971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.399222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f5b3-d361-47f8-a98a-f0f3e41c425c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.404584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.405245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.405521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.405816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.406470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.408303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.442704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1011/2019] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:32.443661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.453258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.470446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30539b-774c-4ca0-a66c-54475b057e1f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.479151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.480622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.481218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.481534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] PATH_INFO: `/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9/users/9559882d2dd74d27b2caffbe7fe44197/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.484158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] RBAC: Authorizing `identity:create_grant(project_id=382fd903a7b54e5e8e4e15180ecbd1d9, user_id=9559882d2dd74d27b2caffbe7fe44197, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.488599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f960-76de-4001-9809-1a775b7c152f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.516804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1012/2020] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:32 2022] PUT /identity/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9/users/9559882d2dd74d27b2caffbe7fe44197/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:32.516804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c84b64-0922-4d92-9864-7157f14494a4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.516804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c84b64-0922-4d92-9864-7157f14494a4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.516804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c84b64-0922-4d92-9864-7157f14494a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.543634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-65c84b64-0922-4d92-9864-7157f14494a4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.545184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-65c84b64-0922-4d92-9864-7157f14494a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.593264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1009/2021] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:32.594380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.613586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.626931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013a756-a0e8-4043-875b-95127c981c6a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.654470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1013/2022] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:32.654470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e05b-0564-4f97-977b-93de4569587f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.654470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e05b-0564-4f97-977b-93de4569587f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.654470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e05b-0564-4f97-977b-93de4569587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.690009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e287e05b-0564-4f97-977b-93de4569587f None None] MFA Rules not processed for user `9559882d2dd74d27b2caffbe7fe44197`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.691253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e287e05b-0564-4f97-977b-93de4569587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.763817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.764608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.764972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.765346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] PATH_INFO: `/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264/users/fbab3a66b97640e9ba6a125e51e63902/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.783621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286788e1b1cb42cb9f9875b3a2fe2264, user_id=fbab3a66b97640e9ba6a125e51e63902, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.786685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.804572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1010/2023] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:32 2022] PUT /identity/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264/users/fbab3a66b97640e9ba6a125e51e63902/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:32.805691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.809065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.832281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1014/2024] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:32.833221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e05b-0564-4f97-977b-93de4569587f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.845002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e05b-0564-4f97-977b-93de4569587f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.877596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5c090-e3c8-425a-a196-50d59ab28978 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.882693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.883360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.883713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.884053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.904999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.912515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.913135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.913445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.913751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.914398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:32.914703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.916917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.928421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1015/2025] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:32.929256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.939295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741db96-fcaf-49dd-95d1-2439fb0b847a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.944215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.944955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.945733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.946143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.946794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.948466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.954781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.956211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.959300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1016/2026] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:32.960097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.961808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.969371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1011/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:32.970219 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.974934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1a06-e91d-4f45-905e-bddb6ba6fd21 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.979334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.979940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.980221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.980488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.980920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6c7b-d3c2-444f-8adc-e031f3e78a9c service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.985774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.986364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.986849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.987257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.987885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.990104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.030818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1012/2028] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:33.030818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.046053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:33.062473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.063973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.076612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1017/2029] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:33.077888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.096028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330107f-7214-4ca7-827c-d3cfdd5fd656 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.123845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec53c5-ad17-42b8-ae68-2d7a1622d6d0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.132135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.133741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.134130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.135189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] PATH_INFO: `/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264/users/fbab3a66b97640e9ba6a125e51e63902/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.138385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286788e1b1cb42cb9f9875b3a2fe2264, user_id=fbab3a66b97640e9ba6a125e51e63902, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.141540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.155056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1013/2030] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:33 2022] PUT /identity/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264/users/fbab3a66b97640e9ba6a125e51e63902/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:33.155056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.179391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.180857 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.181430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.182170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.184022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.187157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf2274-7510-42d1-bbbb-c9a4f979a994 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.224150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1018/2031] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:33.224150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.224150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.224150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.252949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08dd2-97e4-4dff-abe1-c5576ed293a4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.258588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.260403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.261281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.261731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.266197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] MFA Rules not processed for user `fbab3a66b97640e9ba6a125e51e63902`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:33.266392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.267629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.323897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:33.346607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.353060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.366119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1014/2032] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:33.367299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.377393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1019/2033] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:33.408844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.419377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185b5ba-30a2-4a7c-8245-b15a6a6e6377 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.423782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.424400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.424920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.425196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.437300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.439314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.456284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1020/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:33.470880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda1709-c224-44fd-84d1-9538760630ef service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.486458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.487369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.487717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.488346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.490021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.492653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.507654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1015/2035] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:33.511842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.527365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab48f9-9a7a-4155-a9d2-aa1c1f2f6211 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.541977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.541977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.541977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.541977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.542279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.542279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b47cd3-3dbc-43f9-9f62-a3dccd38f787 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.552453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1021/2036] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:33.558784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.579138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a471e-1976-4c67-a183-33b7b9b11c8c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.591169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.591829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.592380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.592658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] PATH_INFO: `/v3/projects/e8b8ddfdb91b41e2a629f1b69e47c9fd/users/2b4a8b73367e4e369f5c9655d5e7cd7f/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.624360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b8ddfdb91b41e2a629f1b69e47c9fd, user_id=2b4a8b73367e4e369f5c9655d5e7cd7f, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.627557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.648046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1016/2037] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:33 2022] PUT /identity/v3/projects/e8b8ddfdb91b41e2a629f1b69e47c9fd/users/2b4a8b73367e4e369f5c9655d5e7cd7f/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:33.653959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.654318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.655200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.705612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:33.706879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.728118 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.779633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:33.815102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1022/2038] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:33.835261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.842143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.874974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760006f4-da99-45df-95b3-81cd83b39908 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.894570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.895203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.895482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.895748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.897563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.982100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5fa2a-053a-4a2c-b59e-0f67738e636e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.988850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.990115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.990479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.990884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.005976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.008378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.023431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1023/2039] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:34.046727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.047806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.060508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1017/2040] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:34.216420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:34.226368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a5ad-4f7a-470d-94c6-a14600446fdd service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:34.230447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:34.231255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.231255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.231594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.233934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.309229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.311012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d1604-b277-47c6-8e4e-b6bf411e95ff service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.324093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1024/2041] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:34.379557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:34.382240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.410313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c685-e757-4857-a7a5-1efeff45c2ea service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:34.419394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:34.420477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.420882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.421257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] PATH_INFO: `/v3/users/fc6ced66eb1a44e8aa482fc0e1d2c0b5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.438049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6ced66eb1a44e8aa482fc0e1d2c0b5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.446041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.451600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:34.544777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6ced66eb1a44e8aa482fc0e1d2c0b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.565973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6ced66eb1a44e8aa482fc0e1d2c0b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.568553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6ced66eb1a44e8aa482fc0e1d2c0b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.571235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6ced66eb1a44e8aa482fc0e1d2c0b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.585574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6ced66eb1a44e8aa482fc0e1d2c0b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.616146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1018/2042] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:34 2022] DELETE /identity/v3/users/fc6ced66eb1a44e8aa482fc0e1d2c0b5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:34.621141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92767e-94df-4fc3-bd72-313fc618ec7c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.621530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92767e-94df-4fc3-bd72-313fc618ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.621901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92767e-94df-4fc3-bd72-313fc618ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.650385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ae92767e-94df-4fc3-bd72-313fc618ec7c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:34.651781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ae92767e-94df-4fc3-bd72-313fc618ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.742920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1025/2043] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:34.753860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:34.756198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.852170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdece0-3c6a-4c62-86a4-4e50f55801de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:34.856942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:34.857583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.857920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.858199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.868642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.870982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.889901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1019/2044] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:34.981366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.981366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.981708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.017760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] MFA Rules not processed for user `2b4a8b73367e4e369f5c9655d5e7cd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:35.019449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.037769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:35.148032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1026/2045] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:35.149233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.151248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.171705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0095-b096-4f53-bfd1-c4bf99b4aff0 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.178392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.179431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.179808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.180176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.180914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.184455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.276924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1020/2046] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:35 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:35.278062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.294129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec59b-da7c-4b7a-9935-7a77627cf7a7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.382385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.383010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.383299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.383567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.384258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.387888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.420851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.422891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1027/2047] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:35 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:35.432285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4dbfd-b077-4147-9dc0-cc80a02fbbc6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.437714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.438398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.438689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.438964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.439670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.442529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.465761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.473391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1021/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:35.477781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd37ec-e35c-4849-8885-bcf5860a746b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.484502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.485554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.486009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.486389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] PATH_INFO: `/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed/users/8a71f434e3a94e7398cf99ca75476899/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.504264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeda69e3af04c78902fbbf2e15c2eed, user_id=8a71f434e3a94e7398cf99ca75476899, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.507916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.559542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1028/2049] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:35 2022] PUT /identity/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed/users/8a71f434e3a94e7398cf99ca75476899/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:35.571196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.589792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05821-deea-45ed-911c-189dd0b274cb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.613620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.615770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.767891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:35.797683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.797683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.797683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.797683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.798057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.802190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.837200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1022/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:35.842272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.843443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b4ea-6e81-4eec-8323-8fbae540009b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.858087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.859717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.859717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.860056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] PATH_INFO: `/v3/projects/6c153e8e0e2546d58d829e8c4f6c2880` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.863760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c153e8e0e2546d58d829e8c4f6c2880)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.865999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.879634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99231-5e6b-4c87-95b3-7d9ce3c41a71 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.894234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.894571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.894864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.895145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] PATH_INFO: `/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed/users/8a71f434e3a94e7398cf99ca75476899/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.897543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeda69e3af04c78902fbbf2e15c2eed, user_id=8a71f434e3a94e7398cf99ca75476899, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.900850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.916402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1023/2051] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:35 2022] PUT /identity/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed/users/8a71f434e3a94e7398cf99ca75476899/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:35.917702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.923857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.940558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:36.003047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c153e8e0e2546d58d829e8c4f6c2880', 'request_id': 'req-060a2891-4c13-4ead-b972-53807866dc63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.014798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c153e8e0e2546d58d829e8c4f6c2880', 'request_id': 'req-060a2891-4c13-4ead-b972-53807866dc63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.033752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c153e8e0e2546d58d829e8c4f6c2880', 'request_id': 'req-060a2891-4c13-4ead-b972-53807866dc63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.050811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] The token cache is being invalidate because project 6c153e8e0e2546d58d829e8c4f6c2880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:36.051450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.052526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.054757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1029/2052] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:35 2022] DELETE /identity/v3/projects/6c153e8e0e2546d58d829e8c4f6c2880 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:36.062040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.065292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.081923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458777-a913-401b-a7a8-0a3126dc3cc2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.196258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.197096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.197672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.198309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] PATH_INFO: `/v3/users/e7ffda4a6415416684d53dad1ce797c6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.200726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ffda4a6415416684d53dad1ce797c6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.203756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.242666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2891-4c13-4ead-b972-53807866dc63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.251484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.252317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.252606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.252884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] PATH_INFO: `/v3/users/fc1df033754b49fd8021c042550141e0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.254153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1df033754b49fd8021c042550141e0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.256364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.288948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ffda4a6415416684d53dad1ce797c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.303137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ffda4a6415416684d53dad1ce797c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.305406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ffda4a6415416684d53dad1ce797c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.307161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ffda4a6415416684d53dad1ce797c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.321690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dedf5804-6511-4cb2-ad8b-ef44cb3d3eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ffda4a6415416684d53dad1ce797c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.333376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1df033754b49fd8021c042550141e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.344681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1df033754b49fd8021c042550141e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.345912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1df033754b49fd8021c042550141e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.360893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:36.366079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1df033754b49fd8021c042550141e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.376136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1024/2053] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:35 2022] DELETE /identity/v3/users/e7ffda4a6415416684d53dad1ce797c6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:36.380987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.381282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.381590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.401254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1df033754b49fd8021c042550141e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.419027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1030/2054] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:36 2022] DELETE /identity/v3/users/fc1df033754b49fd8021c042550141e0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:36.445818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:36.448029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.558338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1025/2055] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:36.572886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.575372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.636888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:36.669326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd160-6bb0-433e-9b5a-bf2a11253b56 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.673007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.673657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.673945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.674222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.684915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.686525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.698763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1031/2056] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:36.988475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.990420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.020558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96524-6b72-483b-8dce-e532d38fce64 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.027402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.028782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.029205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.029627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] PATH_INFO: `/v3/users/4f422fb6372e45f2931275cbdd14ba03` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.030932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f422fb6372e45f2931275cbdd14ba03)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.034117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.115812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f422fb6372e45f2931275cbdd14ba03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.146776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.147002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f422fb6372e45f2931275cbdd14ba03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.148028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f422fb6372e45f2931275cbdd14ba03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.148322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.150633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f422fb6372e45f2931275cbdd14ba03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.166987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9e003429-7591-4457-8c3c-d1fdfee5d0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f422fb6372e45f2931275cbdd14ba03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.169655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f500a2-d185-400d-ab5b-66d9e594849b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.184593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.185426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.185686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.185978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] PATH_INFO: `/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.187286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82901e5681f4aa5b0fd3f076c0626b4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.189335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.208682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1026/2057] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:36 2022] DELETE /identity/v3/users/4f422fb6372e45f2931275cbdd14ba03 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:37.211173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a51d-6d49-4cab-ac6c-3c7ade17ea5c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.212090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a51d-6d49-4cab-ac6c-3c7ade17ea5c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.213446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a51d-6d49-4cab-ac6c-3c7ade17ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.256624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7a45a51d-6d49-4cab-ac6c-3c7ade17ea5c None None] MFA Rules not processed for user `8a71f434e3a94e7398cf99ca75476899`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.271552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7a45a51d-6d49-4cab-ac6c-3c7ade17ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.286688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82901e5681f4aa5b0fd3f076c0626b4', 'request_id': 'req-8c03c915-3eef-46f2-b243-710dd7aa0dce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.301826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82901e5681f4aa5b0fd3f076c0626b4', 'request_id': 'req-8c03c915-3eef-46f2-b243-710dd7aa0dce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.319204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82901e5681f4aa5b0fd3f076c0626b4', 'request_id': 'req-8c03c915-3eef-46f2-b243-710dd7aa0dce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.366839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] The token cache is being invalidate because project e82901e5681f4aa5b0fd3f076c0626b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:37.367991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.370503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c03c915-3eef-46f2-b243-710dd7aa0dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.374074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1032/2058] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:37 2022] DELETE /identity/v3/projects/e82901e5681f4aa5b0fd3f076c0626b4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:37.379884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bfd1-5e08-415f-a38c-8d47b2d5f019 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.380615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bfd1-5e08-415f-a38c-8d47b2d5f019 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.382379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bfd1-5e08-415f-a38c-8d47b2d5f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.440224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:37.451388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cc59bfd1-5e08-415f-a38c-8d47b2d5f019 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.453941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cc59bfd1-5e08-415f-a38c-8d47b2d5f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.465889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1027/2059] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.469723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.469723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.469723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.521116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.523001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.632439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1033/2060] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.634009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.636646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.636884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1028/2061] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.659250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.665280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] MFA Rules not processed for user `2b4a8b73367e4e369f5c9655d5e7cd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.666536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.671477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c297123-ebb6-4aba-ab06-22b510031cd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.676353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.676998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.677282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.677589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] PATH_INFO: `/v3/projects/92813c8fd6d64387a10c6a21a7266f52` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.678887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92813c8fd6d64387a10c6a21a7266f52)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.680868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.730716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:37.747367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1034/2062] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.747367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.748719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.755874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92813c8fd6d64387a10c6a21a7266f52', 'request_id': 'req-94c791b2-1c60-4625-aa98-f5dacebd5f88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.763486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92813c8fd6d64387a10c6a21a7266f52', 'request_id': 'req-94c791b2-1c60-4625-aa98-f5dacebd5f88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.773843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92813c8fd6d64387a10c6a21a7266f52', 'request_id': 'req-94c791b2-1c60-4625-aa98-f5dacebd5f88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.800537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] The token cache is being invalidate because project 92813c8fd6d64387a10c6a21a7266f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:37.801074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.803479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-94c791b2-1c60-4625-aa98-f5dacebd5f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:37.806272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1029/2063] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:37 2022] DELETE /identity/v3/projects/92813c8fd6d64387a10c6a21a7266f52 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:37.808098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.808386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.808656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.846838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414934a-4771-43e5-b210-e5a0ed232501 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.858959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.860895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.926108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.928726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.929169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.930959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.941449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.942665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1030/2064] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.944079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.948564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.970831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.972783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe91e-587c-4ac0-b97f-74e389730070 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.980333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:37.984385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1035/2065] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:37.986284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.986677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.987058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.014721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:38.016356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.027847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1036/2066] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:38.028924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.041590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e3cc-a11f-4636-8bd5-dbac65015466 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.048190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.048511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.048730 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.049218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.049920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:38.050228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.052230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccde90-4f2d-4180-a3fc-894d4ca303e5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.056911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b026741-4db1-4ac0-a595-67448fa5b75f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.068909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.069949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.070763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.071418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.073676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1037/2067] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:38.075256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.076155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.077149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.077613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.117647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:38.119770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.130017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1038/2068] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:38.131126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.153820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069052c9-04a2-4227-8165-14eda7b4d0bc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.160160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.161707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.162227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.162766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.163883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.166961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.190016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.191434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.203225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1039/2069] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:38.204676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.213146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1031/2070] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:38.214617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.236782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae67f9-9356-4711-9903-685368df44d2 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.319860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97032-3083-4fb8-b677-75796977e8d0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.328804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.329590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.330237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.330623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.332153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:38.332882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.335065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.353988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1040/2071] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:38.358630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.366165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:38.373319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.373992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.374276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.374552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.374679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f439-c49d-4216-9605-1c5bf12be822 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.375207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.377329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.381543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.382291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.382673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.383051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.383818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.386195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.411707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1032/2072] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:38.425750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.442525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1041/2073] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:38.443698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.446393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750dc9d-c114-4aae-82a8-b2a92221eafb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.522334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:38.539217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.539944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.540294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.541695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.542693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.544632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.567011 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1033/2074] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:38.572334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.589917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7f0cd-3cfb-4958-addc-8cec719e051e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.596530 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.597310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.597704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.598100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.598914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.600960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.604093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc485c-1d68-4a32-b11b-b026d59dadea admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.623375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.624590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1034/2075] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:38.625898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.627892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.628391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.628790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.629233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.630021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.634386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.665753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1042/2076] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:38.668350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfed1-71d6-4ede-86b6-41f87147df08 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.670152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.675331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.676325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.676776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.677330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] PATH_INFO: `/v3/projects/3133414a7c44427eab3946a811a7fde7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.678645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3133414a7c44427eab3946a811a7fde7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.680577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.686809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00671a-41b1-457b-b3ed-ba4eddf53f29 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.692598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.693071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.693414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.693821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] PATH_INFO: `/v3/projects/f7926241cd4049fb866544bccee80a51/users/3a65ae3586344352818a2cdc114c9281/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.723382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7926241cd4049fb866544bccee80a51, user_id=3a65ae3586344352818a2cdc114c9281, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.726694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.742445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1043/2077] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:38 2022] PUT /identity/v3/projects/f7926241cd4049fb866544bccee80a51/users/3a65ae3586344352818a2cdc114c9281/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:38.742702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3133414a7c44427eab3946a811a7fde7', 'request_id': 'req-fe6bd3c3-0aab-4404-a9b5-940e02791997'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.744329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.760105 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3133414a7c44427eab3946a811a7fde7', 'request_id': 'req-fe6bd3c3-0aab-4404-a9b5-940e02791997'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.767536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3133414a7c44427eab3946a811a7fde7', 'request_id': 'req-fe6bd3c3-0aab-4404-a9b5-940e02791997'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.785581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] The token cache is being invalidate because project 3133414a7c44427eab3946a811a7fde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:38.786266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.787140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fe6bd3c3-0aab-4404-a9b5-940e02791997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.791356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1035/2078] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:38 2022] DELETE /identity/v3/projects/3133414a7c44427eab3946a811a7fde7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:38.793690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.794705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.795394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.836586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] MFA Rules not processed for user `3a65ae3586344352818a2cdc114c9281`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:38.838077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b33cd-845a-40d3-92fe-f08f3c2b648d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.839152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.843572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.844239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.844542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.844798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.845616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.847285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.860431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1044/2079] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:38.861314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.864871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.883499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9c3df-e188-4c0a-bc81-8be5a4f6bea3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.895601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.897233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.897593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.898559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] PATH_INFO: `/v3/users/fbab3a66b97640e9ba6a125e51e63902` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.900745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbab3a66b97640e9ba6a125e51e63902)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.904868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.982960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1036/2080] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:38.986829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.989794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.008426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.018673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbab3a66b97640e9ba6a125e51e63902'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.025117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b64fb-0ef5-41b3-8a1a-e6d50a153d60 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.030273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbab3a66b97640e9ba6a125e51e63902'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.031059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbab3a66b97640e9ba6a125e51e63902'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.042581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.043138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbab3a66b97640e9ba6a125e51e63902'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.043272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.043483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.043757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.044407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.046411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.066226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1037/2081] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:39.070362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.072633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.073913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbab3a66b97640e9ba6a125e51e63902'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.086710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c45f1a-6ec2-428d-8504-c28a12829d9e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.093579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.094210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.094636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.094914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.095549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.097456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.098102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1045/2082] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:38 2022] DELETE /identity/v3/users/fbab3a66b97640e9ba6a125e51e63902 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:39.100196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.106696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.138865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1038/2083] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:39 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:39.143715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.168293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.278142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6deac-a464-4eb5-a5c2-49bbb3a36141 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.288651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.289279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.291065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.291467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.292221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.294927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.344860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a365-1b55-45f0-ab9e-a3b1df27ff5d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.373826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.373826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.373826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.373826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] PATH_INFO: `/v3/projects/cb22b8451d2c4174966fd2c15bee5367/users/9afb577f485044bf917be3a9327da113/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.384887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1039/2084] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:39 2022] POST /identity/v3/users => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:39.386073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.394497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.409689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb22b8451d2c4174966fd2c15bee5367, user_id=9afb577f485044bf917be3a9327da113, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.416152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.447504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1046/2085] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:39 2022] PUT /identity/v3/projects/cb22b8451d2c4174966fd2c15bee5367/users/9afb577f485044bf917be3a9327da113/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:39.448454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.560793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb815d-aa70-4ce7-afcd-dd118505afca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.613494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264ac4-6d76-45b1-bc8a-4cfc7ea3ed95 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.628771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.631058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.631394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.631674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.633226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.635784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1da33-4282-4557-af25-a8d53f0a7944 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.653104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1047/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:39.655153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041f22-faeb-4605-8c5d-224129391dac None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.656341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041f22-faeb-4605-8c5d-224129391dac None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.656679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041f22-faeb-4605-8c5d-224129391dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.693910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.694549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.694812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.695085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.701019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.765142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-24041f22-faeb-4605-8c5d-224129391dac None None] MFA Rules not processed for user `9afb577f485044bf917be3a9327da113`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:39.766482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-24041f22-faeb-4605-8c5d-224129391dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.842076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.843756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.846783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.890780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1040/2087] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:39.891897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.927201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85e3c4-4df7-49c4-9c89-4655e95bcd24 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.946558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.947416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.947585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.947859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] PATH_INFO: `/v3/projects/477290f100d44ebead142ddc568b2514/users/2d9de4bf0e8e4e37907c73c73b7c4334/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.958162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.991842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477290f100d44ebead142ddc568b2514, user_id=2d9de4bf0e8e4e37907c73c73b7c4334, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.995399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.016521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1048/2088] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:40.019448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24041f22-faeb-4605-8c5d-224129391dac None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.035987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1041/2089] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:39 2022] PUT /identity/v3/projects/477290f100d44ebead142ddc568b2514/users/2d9de4bf0e8e4e37907c73c73b7c4334/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.036853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.042592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-24041f22-faeb-4605-8c5d-224129391dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.046492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.076512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24041f22-faeb-4605-8c5d-224129391dac None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.192798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed33f-9971-415b-8814-bd5abc145956 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.207046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.207277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.208011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.208151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.208371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.208630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.208740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.209113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] PATH_INFO: `/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.210583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286788e1b1cb42cb9f9875b3a2fe2264)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.216576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.346077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286788e1b1cb42cb9f9875b3a2fe2264', 'request_id': 'req-fec1f73f-e9c7-4313-a317-1dc714d460e9'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.350279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.354569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.360716 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286788e1b1cb42cb9f9875b3a2fe2264', 'request_id': 'req-fec1f73f-e9c7-4313-a317-1dc714d460e9'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.370514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286788e1b1cb42cb9f9875b3a2fe2264', 'request_id': 'req-fec1f73f-e9c7-4313-a317-1dc714d460e9'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.378832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1042/2090] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:40.379762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.395272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] The token cache is being invalidate because project 286788e1b1cb42cb9f9875b3a2fe2264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:40.395562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.396390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fec1f73f-e9c7-4313-a317-1dc714d460e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.400161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1049/2091] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:40 2022] DELETE /identity/v3/projects/286788e1b1cb42cb9f9875b3a2fe2264 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.401965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c366db-ae25-42e5-8603-7498446b7bb9 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.405259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4085f-8fa9-4859-a3be-158360fbd437 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.405567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4085f-8fa9-4859-a3be-158360fbd437 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.405896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4085f-8fa9-4859-a3be-158360fbd437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.469707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-28d4085f-8fa9-4859-a3be-158360fbd437 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:40.470874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-28d4085f-8fa9-4859-a3be-158360fbd437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.602711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.603390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.603670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.603938 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.604594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.606234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.621539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:40.638147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1043/2092] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:40.641637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.644524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.648500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1050/2093] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:40.658982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.660017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.661031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.665836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61c5c4-0fcb-4201-8682-85b53bd22667 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.673184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.674057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.674404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.674741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] PATH_INFO: `/v3/projects/477290f100d44ebead142ddc568b2514/users/2d9de4bf0e8e4e37907c73c73b7c4334/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.677924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] RBAC: Authorizing `identity:create_grant(project_id=477290f100d44ebead142ddc568b2514, user_id=2d9de4bf0e8e4e37907c73c73b7c4334, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.681314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b749eac-b7b7-4694-871c-df717f8a10be admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.696043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1044/2094] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:40 2022] PUT /identity/v3/projects/477290f100d44ebead142ddc568b2514/users/2d9de4bf0e8e4e37907c73c73b7c4334/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.708737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.709373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.710066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.715661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:40.717226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.763601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] MFA Rules not processed for user `2d9de4bf0e8e4e37907c73c73b7c4334`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:40.765450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.781153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:40.816757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1051/2095] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:40.822227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.834250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca93495-f41c-46ac-82b0-6ef1227a9189 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.855874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.857681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.858022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.858339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.859986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1045/2096] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:40.860765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:40.861110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.862882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.880859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.882393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.888307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1052/2097] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:40.901755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.928481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47762503-c1f4-473b-bdc2-d2b14ab18277 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.938877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.939700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.941101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.941442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.943155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.948740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.999926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1053/2098] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:40 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:41.005239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.017353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e0f40-f57d-4f55-b410-599d6c264742 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.075450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.076064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.076343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.076706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.078538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.093797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941df42-6a8f-4433-a708-2e9af8a9ab3c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.101338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.102012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.102336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.102645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.103418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.105353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.144528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1054/2099] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.149027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.151040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.152540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.160093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ce5b9-65d3-49f9-af31-ac5ffb95f060 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.163213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1046/2100] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:41.167120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.167735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.168066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.168867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.169342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.170924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.183169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1055/2101] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:41.187203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.199918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a095418-e4e2-440f-97f5-fb9cfea83e9e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.204899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.205533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.206112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.206314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.206968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.208619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae30e3-6635-47dd-9e28-7424841880a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.220101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1047/2102] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:41.224325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.245956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932408-756b-4f7d-b910-74035be22ed5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.249160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.249921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.250210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.250507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] PATH_INFO: `/v3/projects/78873af1bb4f43028eff092d6341c8aa/users/77b18e5288c04a3a84e3cb24c8d1a7d5/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.267569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78873af1bb4f43028eff092d6341c8aa, user_id=77b18e5288c04a3a84e3cb24c8d1a7d5, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.270503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.286097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1056/2103] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:41 2022] PUT /identity/v3/projects/78873af1bb4f43028eff092d6341c8aa/users/77b18e5288c04a3a84e3cb24c8d1a7d5/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:41.297115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.297409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.297780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.320373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.331189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] MFA Rules not processed for user `77b18e5288c04a3a84e3cb24c8d1a7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.332454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.405974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1048/2104] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:41.411134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.431384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.487766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16babc6d-bd47-474b-bdd6-d2c0c5f1c928 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.493029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.494339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.494665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.494978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.495646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.497621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.534328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1057/2105] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.535469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.547695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebd29c-f818-4f8a-bba6-549eb11dcd80 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.616745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.617378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.617724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.618079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.619521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.621766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.657404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1049/2106] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.658316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.675213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d073-5fc3-4578-a04e-f2e59a74268f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.681612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.682190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.682521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.682926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.683662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.685597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.713598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1058/2107] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:41.718358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.732474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84c1d-cb4d-4f92-a90d-f5ddae04fa20 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.738471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.739521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.740023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.741031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] PATH_INFO: `/v3/projects/b926a92826b94597bbb03ab8cf1d377f/users/70ad7c8da840418980adbd82eafd9ecd/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.761571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b926a92826b94597bbb03ab8cf1d377f, user_id=70ad7c8da840418980adbd82eafd9ecd, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.764447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.779501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1050/2108] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:41 2022] PUT /identity/v3/projects/b926a92826b94597bbb03ab8cf1d377f/users/70ad7c8da840418980adbd82eafd9ecd/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:41.784164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.797014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630952-edac-46c1-891a-93634aec0a3a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.878151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.879105 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.879653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.879990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.880750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.882640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d64ee-426b-40ec-bfb1-271d796ca558 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.908469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1059/2109] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:41.913209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.925311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaeac1-6faa-421a-8212-accacbebc700 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.930356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.931053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.931333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.931603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] PATH_INFO: `/v3/projects/b926a92826b94597bbb03ab8cf1d377f/users/70ad7c8da840418980adbd82eafd9ecd/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.933804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b926a92826b94597bbb03ab8cf1d377f, user_id=70ad7c8da840418980adbd82eafd9ecd, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.936556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.947904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1051/2110] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:41 2022] PUT /identity/v3/projects/b926a92826b94597bbb03ab8cf1d377f/users/70ad7c8da840418980adbd82eafd9ecd/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:41.959673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.960007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.960323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.995341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] MFA Rules not processed for user `70ad7c8da840418980adbd82eafd9ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.996574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.088821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1060/2111] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:42.102160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.173325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8c28-9932-4472-b0d2-92c5151b541d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.177453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.178169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.178390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.178780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.185621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:42.191833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.193290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477777c-d463-4361-8665-28a34ad7a36b service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.208341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1052/2112] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:42.402788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.418485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:42.478744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a536e-1254-49a9-aebf-4989c4f6fa25 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.484627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.485340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.485822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.486031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] PATH_INFO: `/v3/users/77b18e5288c04a3a84e3cb24c8d1a7d5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.487518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b18e5288c04a3a84e3cb24c8d1a7d5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.490031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.544610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b18e5288c04a3a84e3cb24c8d1a7d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.552305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b18e5288c04a3a84e3cb24c8d1a7d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.552956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b18e5288c04a3a84e3cb24c8d1a7d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.562984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b18e5288c04a3a84e3cb24c8d1a7d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.579876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b18e5288c04a3a84e3cb24c8d1a7d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.586988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1061/2113] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:42 2022] DELETE /identity/v3/users/77b18e5288c04a3a84e3cb24c8d1a7d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:42.594336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.594865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.594949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.617472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:42.619171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.712308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1053/2114] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:42.722779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.724400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.904850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00848-8f2e-4276-991c-525bb809906f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.932581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.935780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.943754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.944213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.965384 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.967208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78701e-cb21-426c-b63b-4bc8a99acbbb service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.030341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1062/2115] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:43.186487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.188341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.238692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8d0ab-3d72-45ac-8af5-2e6b242a7598 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.276453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.277226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.277534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.277810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] PATH_INFO: `/v3/users/3b5233ed0aa746309f9cbe46067f2408` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.294669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5233ed0aa746309f9cbe46067f2408)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.304565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.440961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5233ed0aa746309f9cbe46067f2408'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.453415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5233ed0aa746309f9cbe46067f2408'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.463549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5233ed0aa746309f9cbe46067f2408'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.464642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5233ed0aa746309f9cbe46067f2408'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.508099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5233ed0aa746309f9cbe46067f2408'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.560817 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1054/2116] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:43 2022] DELETE /identity/v3/users/3b5233ed0aa746309f9cbe46067f2408 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:43.566779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.567339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.567532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.622072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:43.622072 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.705984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.786690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1063/2117] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:43.803991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.805802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.840657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.842263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.866819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f284d56-9c0a-437b-81a5-85eff0128b19 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.895674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.897731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.898271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.898897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] PATH_INFO: `/v3/projects/78873af1bb4f43028eff092d6341c8aa` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.901886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78873af1bb4f43028eff092d6341c8aa)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.904277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.924636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ead7b-3f11-461b-9abd-a0053311ad8b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.929263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.929922 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.930266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.930548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.943363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.944906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.964812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1055/2118] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:43.981552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78873af1bb4f43028eff092d6341c8aa', 'request_id': 'req-10456231-78a1-4c72-9e00-24e775df66c1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.987634 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78873af1bb4f43028eff092d6341c8aa', 'request_id': 'req-10456231-78a1-4c72-9e00-24e775df66c1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.996696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78873af1bb4f43028eff092d6341c8aa', 'request_id': 'req-10456231-78a1-4c72-9e00-24e775df66c1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.013765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] The token cache is being invalidate because project 78873af1bb4f43028eff092d6341c8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:44.014129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.015437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.017115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1064/2119] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:43 2022] DELETE /identity/v3/projects/78873af1bb4f43028eff092d6341c8aa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:44.021776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.032543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe5919-86e6-4f3f-85af-04a70dbc7270 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.041857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:44.130927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.131573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.131852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.132125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] PATH_INFO: `/v3/users/70ad7c8da840418980adbd82eafd9ecd` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.134122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ad7c8da840418980adbd82eafd9ecd)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.136512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:44.210848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ad7c8da840418980adbd82eafd9ecd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.222323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ad7c8da840418980adbd82eafd9ecd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.223189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ad7c8da840418980adbd82eafd9ecd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.223882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ad7c8da840418980adbd82eafd9ecd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.233037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ad7c8da840418980adbd82eafd9ecd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.253065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1056/2120] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:44 2022] DELETE /identity/v3/users/70ad7c8da840418980adbd82eafd9ecd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:44.717871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.719358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.742057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10456231-78a1-4c72-9e00-24e775df66c1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.902116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.903321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.903321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.903639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] PATH_INFO: `/v3/projects/806ac9640165461b8df5c8ef83499ebe` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.905068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806ac9640165461b8df5c8ef83499ebe)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.910941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.015921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806ac9640165461b8df5c8ef83499ebe', 'request_id': 'req-e3fc0a9d-5509-4f16-bf99-4df945e81038'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.031195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.031195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.053177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0feafa-3c3e-4f13-8188-d7b0e6c4f442 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.053977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806ac9640165461b8df5c8ef83499ebe', 'request_id': 'req-e3fc0a9d-5509-4f16-bf99-4df945e81038'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.073043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:45.092887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806ac9640165461b8df5c8ef83499ebe', 'request_id': 'req-e3fc0a9d-5509-4f16-bf99-4df945e81038'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.152609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] The token cache is being invalidate because project 806ac9640165461b8df5c8ef83499ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:45.152609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.153110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.155093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1065/2121] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:44 2022] DELETE /identity/v3/projects/806ac9640165461b8df5c8ef83499ebe => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:45.159037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.162802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.207992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.208647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.209489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.210224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] PATH_INFO: `/v3/projects/b926a92826b94597bbb03ab8cf1d377f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.212945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b926a92826b94597bbb03ab8cf1d377f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.216146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.267740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0a9d-5509-4f16-bf99-4df945e81038 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.273746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:45.274408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.275302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.275707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.276101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] PATH_INFO: `/v3/users/60bafefd39a7405caa9326a5fd5b2954` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.277369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60bafefd39a7405caa9326a5fd5b2954)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.279734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.291400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b926a92826b94597bbb03ab8cf1d377f', 'request_id': 'req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.298136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b926a92826b94597bbb03ab8cf1d377f', 'request_id': 'req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.308652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b926a92826b94597bbb03ab8cf1d377f', 'request_id': 'req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.322560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] The token cache is being invalidate because project b926a92826b94597bbb03ab8cf1d377f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:45.322853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.323717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6954c088-8364-4f66-8f1c-ed6dfc6b4f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.325229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1057/2122] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/projects/b926a92826b94597bbb03ab8cf1d377f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:45.330003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.330477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.330755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.340991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60bafefd39a7405caa9326a5fd5b2954'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.351433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60bafefd39a7405caa9326a5fd5b2954'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.352068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:45.352366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60bafefd39a7405caa9326a5fd5b2954'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.353855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.363948 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60bafefd39a7405caa9326a5fd5b2954'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.383781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ede6e7e-b70d-4499-8ab2-facd4db5913b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60bafefd39a7405caa9326a5fd5b2954'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.391889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1066/2123] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/users/60bafefd39a7405caa9326a5fd5b2954 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:45.431253 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1058/2124] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:45.439594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.439953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.440292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.465355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:45.467135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.556047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1067/2125] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:45.562177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.575428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a0c6-943d-46e5-bad0-ba47521cb36c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.582757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.583752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.584408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.584839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.585801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:45.586268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.590207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.606264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1059/2126] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:45.610325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.622702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e2ef-ec40-49c9-adf4-613c30df54aa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.628044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.628443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.628813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.629301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.630063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.632194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.638112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:45.677678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1068/2127] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:45 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:45.681802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.693028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798dbc3-9bba-4a94-b5f8-3808c0f2397c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.755483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.759336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.770208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.771544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.772310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.772594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.773376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.777573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.779090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8ef25-68cd-4785-91f9-7484db563aab admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.787100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.789673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.792216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.792722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] PATH_INFO: `/v3/projects/a36fa0ca9bc34b519ed56b5bb748435c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.795051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36fa0ca9bc34b519ed56b5bb748435c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.797369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.811356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1060/2128] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:45 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:45.815097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.827140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284df6-b082-45fc-a6b4-5f1c3ec7f774 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.832318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.832934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.833217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.833487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.834259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.836094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.851473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1061/2129] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:45.856103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.867138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c5b56-f1ae-48e5-9f2e-4597a03cbde8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.871884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36fa0ca9bc34b519ed56b5bb748435c', 'request_id': 'req-4ff1c243-6548-45eb-84a4-5385e9d8f027'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.880738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36fa0ca9bc34b519ed56b5bb748435c', 'request_id': 'req-4ff1c243-6548-45eb-84a4-5385e9d8f027'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.892788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:45.893613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36fa0ca9bc34b519ed56b5bb748435c', 'request_id': 'req-4ff1c243-6548-45eb-84a4-5385e9d8f027'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.910975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] The token cache is being invalidate because project a36fa0ca9bc34b519ed56b5bb748435c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:45.911697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.912881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.915276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1069/2130] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/projects/a36fa0ca9bc34b519ed56b5bb748435c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:45.919783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.922151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.949872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.950709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.957573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.964550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.966488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.968622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.987939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1062/2131] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:45.992081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.994098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.010245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0ef1-7852-46b3-a701-fe52a7f257b4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.019709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.020387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.020665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.020937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] PATH_INFO: `/v3/projects/12e2f573653e4ba48bb2ce04f5a0dc5a/users/980be87eeab54d40a62e861cc60d5f61/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.039140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e2f573653e4ba48bb2ce04f5a0dc5a, user_id=980be87eeab54d40a62e861cc60d5f61, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.042121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc981-06a7-43ed-a907-bd05f27bea5e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.056099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1c243-6548-45eb-84a4-5385e9d8f027 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.058956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1063/2132] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:45 2022] PUT /identity/v3/projects/12e2f573653e4ba48bb2ce04f5a0dc5a/users/980be87eeab54d40a62e861cc60d5f61/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:46.069936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.070543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.072328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.159100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] MFA Rules not processed for user `980be87eeab54d40a62e861cc60d5f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:46.162271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.204099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.204867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.205244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.206806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] PATH_INFO: `/v3/users/9559882d2dd74d27b2caffbe7fe44197` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.207520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9559882d2dd74d27b2caffbe7fe44197)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.209630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.241294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.313464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9559882d2dd74d27b2caffbe7fe44197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.328691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1064/2133] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:46.329619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.330966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9559882d2dd74d27b2caffbe7fe44197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.338722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9559882d2dd74d27b2caffbe7fe44197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.352793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9559882d2dd74d27b2caffbe7fe44197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.354658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390dde1-8a3f-43ea-b424-3b971dce88fa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.373270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9559882d2dd74d27b2caffbe7fe44197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.376870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.378485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.378773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.379049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.379691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.392926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1070/2134] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/users/9559882d2dd74d27b2caffbe7fe44197 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:46.393092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.412827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.414293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.472864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1065/2135] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:46.473880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.475614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.489627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4deb6a-e060-4950-8fb0-0974d8b4dbd1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.569861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.571190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.572803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.573963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.579334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.649188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8d4-6d67-4ab5-8232-a65fad736486 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.677026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.678508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.679653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.679955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.680662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.684474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.714283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.729309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1066/2136] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:46.732926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.756328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83372a6-3a2b-4747-a687-8683a7acb7ad admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.770579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.772091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.773475 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.773732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.775673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.776177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.778654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.780127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.798048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.813583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1067/2137] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:46.815085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.816357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1071/2138] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:46.846998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.848436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.864081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d27716-4e1f-4ed9-ae72-68d41ae70361 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.869135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.869889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.870229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.870639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] PATH_INFO: `/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.871842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=382fd903a7b54e5e8e4e15180ecbd1d9)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.874342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.889181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aebdc-1fd0-41ed-a230-05555e60e407 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.901954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.903024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.903447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.903613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.905300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.907087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.929756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1068/2139] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:46.932713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.975398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97eb0-9b6b-486e-9cb8-568d6e7d209b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.987157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382fd903a7b54e5e8e4e15180ecbd1d9', 'request_id': 'req-b3e713f2-faff-4420-ac53-8e81bb183c0b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.994632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382fd903a7b54e5e8e4e15180ecbd1d9', 'request_id': 'req-b3e713f2-faff-4420-ac53-8e81bb183c0b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:47.018792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382fd903a7b54e5e8e4e15180ecbd1d9', 'request_id': 'req-b3e713f2-faff-4420-ac53-8e81bb183c0b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:47.043054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] The token cache is being invalidate because project 382fd903a7b54e5e8e4e15180ecbd1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:47.043405 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:47.045648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3e713f2-faff-4420-ac53-8e81bb183c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:47.049074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1072/2140] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:46 2022] DELETE /identity/v3/projects/382fd903a7b54e5e8e4e15180ecbd1d9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:47.056868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc6d3-3ab7-4a5b-9e7e-73b6b177b4b0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.057484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc6d3-3ab7-4a5b-9e7e-73b6b177b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.058047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc6d3-3ab7-4a5b-9e7e-73b6b177b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.086781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.087786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.088071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.088851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] PATH_INFO: `/v3/projects/1205e93933d94ac8931f164748728ff4/users/167f36b4be8b46e690ea805f40cf19fb/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.101398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-125bc6d3-3ab7-4a5b-9e7e-73b6b177b4b0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.103206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-125bc6d3-3ab7-4a5b-9e7e-73b6b177b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.111314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1205e93933d94ac8931f164748728ff4, user_id=167f36b4be8b46e690ea805f40cf19fb, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.113054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1073/2141] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:47.114031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1fb02-8e39-4c8c-8e77-ea11ec97b694 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.124358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.124814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.125211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.136760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1069/2142] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:46 2022] PUT /identity/v3/projects/1205e93933d94ac8931f164748728ff4/users/167f36b4be8b46e690ea805f40cf19fb/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:47.148914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628233-c311-45b0-b510-450312e5232f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.149306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628233-c311-45b0-b510-450312e5232f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.149833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628233-c311-45b0-b510-450312e5232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.151239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.152615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.183248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c7628233-c311-45b0-b510-450312e5232f None None] MFA Rules not processed for user `167f36b4be8b46e690ea805f40cf19fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.184668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7628233-c311-45b0-b510-450312e5232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.224659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1074/2143] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:47.236692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.253140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771477-c945-4a7b-a20e-b2cf2118440d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.258315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.259685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.260669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.261303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.262718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:47.263142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.265186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.275711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1070/2144] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:47.276750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628233-c311-45b0-b510-450312e5232f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.278365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7628233-c311-45b0-b510-450312e5232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.282189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1075/2145] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:47.286653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.303181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628233-c311-45b0-b510-450312e5232f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.305275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e38b3-d729-4844-9804-07a0818befe5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.309162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.310367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.310367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.310367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.310999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.311392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.312338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.312591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.312935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.313139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.313720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.316213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.350929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1071/2146] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.355000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1076/2147] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.359151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.359326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.391094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.419772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.434097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65195-7885-4139-9ea2-35efb46ea341 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.438957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.439183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f5b8-7a1b-4d04-b460-ef5c9a240cdb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.439568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.439854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.440116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.440748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.442750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.443911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.444502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.444802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.445075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.445738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.447776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.465761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1072/2148] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.469746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.470093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1077/2149] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.473874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.481040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b2b43-5798-4fd8-ba9d-eca210ceb665 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.484053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5266-c336-4da5-beae-61c691596195 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.486021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.486642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.486930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.487208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.487852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.488956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.489455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.489594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.489864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.490137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.490830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.492464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.503952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1073/2150] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:47.504120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1078/2151] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:47.504983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.507169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.515427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d834-2234-45eb-9f4d-8d2c2023b559 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.518411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2166-268e-44cb-ac37-623f0cbcef99 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.520258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.520851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.521158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.521441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.522110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.523046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.523742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.523856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.524068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.524372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] PATH_INFO: `/v3/projects/9dafbe1498b2408988d9883a89708f51/users/7a8e6bdf372540f79cb796026cf77ef7/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.533665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1074/2152] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:47.538291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.541803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dafbe1498b2408988d9883a89708f51, user_id=7a8e6bdf372540f79cb796026cf77ef7, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.544599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.551041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d638c0-23b9-4759-b20d-cd0a6da1c1bb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.556859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.557545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.557945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.558240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] PATH_INFO: `/v3/projects/95afceb7e519491cae5b80e1546be9fa/users/7ac187ed46224b5db5be6d3d03e289cb/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.563976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1079/2153] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:47 2022] PUT /identity/v3/projects/9dafbe1498b2408988d9883a89708f51/users/7a8e6bdf372540f79cb796026cf77ef7/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:47.565152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.574343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95afceb7e519491cae5b80e1546be9fa, user_id=7ac187ed46224b5db5be6d3d03e289cb, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.577441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd9a6b-bf67-41bf-9941-72847d612155 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.600489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1075/2154] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:47 2022] PUT /identity/v3/projects/95afceb7e519491cae5b80e1546be9fa/users/7ac187ed46224b5db5be6d3d03e289cb/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:47.613780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.614134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.614556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.641273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e01fc-7484-4232-86bf-d293ac5669ce admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.651859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] MFA Rules not processed for user `7ac187ed46224b5db5be6d3d03e289cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.653071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.706561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.707389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.707839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.708267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.708933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.710647 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.721753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1080/2155] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:47.725915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.731702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1076/2156] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:47.735734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.736552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7533d1-a46f-427f-98e3-f62d49faef8a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.741402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.742076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.742350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.742629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] PATH_INFO: `/v3/projects/9dafbe1498b2408988d9883a89708f51/users/7a8e6bdf372540f79cb796026cf77ef7/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.744739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dafbe1498b2408988d9883a89708f51, user_id=7a8e6bdf372540f79cb796026cf77ef7, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.747007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f584-27e7-4dbb-b5ca-224435bebcdc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.747407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b940a-ccda-4fde-83a6-0245580e098e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.752072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.752757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.753106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.753447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.754186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.756157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.758059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1081/2157] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:47 2022] PUT /identity/v3/projects/9dafbe1498b2408988d9883a89708f51/users/7a8e6bdf372540f79cb796026cf77ef7/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:47.768394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.768678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.768954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.785547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1077/2158] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:47.789317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.800550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] MFA Rules not processed for user `7a8e6bdf372540f79cb796026cf77ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.802091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.817886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.828655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.864119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f4291-0ae9-42ed-9bff-c87bdf66dbf3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.869353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.870017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.870297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.870576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.871240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.873181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.881577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1082/2159] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:47.894074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.895004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1078/2160] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:47.895427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.898798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.909740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106003-578a-49dd-ad40-399600f13988 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.915044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.916226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.916510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.917304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.918293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.920614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.931592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1079/2161] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:47.935892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.952722 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ba66-f153-4af0-a15e-2bf5a180ae18 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.966339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.967141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.967307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.967566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] PATH_INFO: `/v3/projects/f6778006842a47c6ba16468e698973cb/users/85adccb337e8424a983bc386d43dfe7b/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.968080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eae87-7d73-4e72-8d78-71006ecfd28a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.979498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.980996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.981364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.982480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.986714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6778006842a47c6ba16468e698973cb, user_id=85adccb337e8424a983bc386d43dfe7b, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.989685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.996532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.998017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.014844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1080/2162] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:47 2022] PUT /identity/v3/projects/f6778006842a47c6ba16468e698973cb/users/85adccb337e8424a983bc386d43dfe7b/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:48.021344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.025945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1083/2163] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:48.079288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.093549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87da3-a42f-4920-bec8-07ecbe53ebb3 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.127705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e3e0b-7a4c-4704-85b4-27d5ff5be3f5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.135800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.137001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.137126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.137379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.138106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.141351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.155901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1081/2164] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:48.160616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.172139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1249ca-4cd8-4e49-948b-ea798a4fd593 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.175033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.175957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.176632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.177051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.179516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:48.180491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.181440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.181798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.182249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] PATH_INFO: `/v3/projects/f6778006842a47c6ba16468e698973cb/users/85adccb337e8424a983bc386d43dfe7b/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.186463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6778006842a47c6ba16468e698973cb, user_id=85adccb337e8424a983bc386d43dfe7b, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.192423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6205d21-880d-4276-b0e7-020cecf03378 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.230588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1082/2165] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:48 2022] PUT /identity/v3/projects/f6778006842a47c6ba16468e698973cb/users/85adccb337e8424a983bc386d43dfe7b/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:48.232979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.233271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.233579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.280075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.280622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] MFA Rules not processed for user `85adccb337e8424a983bc386d43dfe7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:48.282117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:48.284809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.307882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1084/2166] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:48.391640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:48.413933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1083/2167] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:48.431632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.441188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee01d5-dee8-4c04-aa20-009a5a05b3e0 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.448660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:48.521986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.522858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.523350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.523839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.539332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.542377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.553736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1085/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:48.824169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.849491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb1f3-49db-4f6d-9074-03b067a379b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.858764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.859410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.859681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.860221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.966794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.968846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3db82e-6ce1-4e9e-abe7-1126ad6961d4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.991042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1084/2169] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:51.763199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:51.849489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52439a-fdcf-4be6-8343-6950d669c837 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:51.857750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:51.857750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.857750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.857750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] PATH_INFO: `/v3/users/980be87eeab54d40a62e861cc60d5f61` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:51.862187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980be87eeab54d40a62e861cc60d5f61)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:51.864938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:51.927216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980be87eeab54d40a62e861cc60d5f61'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.937545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980be87eeab54d40a62e861cc60d5f61'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.938386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980be87eeab54d40a62e861cc60d5f61'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.950638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980be87eeab54d40a62e861cc60d5f61'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.968518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980be87eeab54d40a62e861cc60d5f61'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.974985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1086/2170] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:51 2022] DELETE /identity/v3/users/980be87eeab54d40a62e861cc60d5f61 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:51.979656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.980154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.980236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.003862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:52.005369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.108564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1085/2171] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:52.120191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.122571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.195872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:52.292264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e00cc-743a-4561-ae37-cec16a4c5898 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.300867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.301947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.302585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.303743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.335620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.336918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.375184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.383060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ecc3d-7ca2-43fe-94b8-a1ced9999a7c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.395872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842fb7-7227-4b47-a761-68b300b455d3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.407841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.409717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.410014 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.410292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] PATH_INFO: `/v3/users/3a65ae3586344352818a2cdc114c9281` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.411685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a65ae3586344352818a2cdc114c9281)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.413661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.418525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1087/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:52.519628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a65ae3586344352818a2cdc114c9281'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.537281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a65ae3586344352818a2cdc114c9281'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.539042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a65ae3586344352818a2cdc114c9281'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.540466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a65ae3586344352818a2cdc114c9281'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.560897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a65ae3586344352818a2cdc114c9281'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.604892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1086/2173] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:52 2022] DELETE /identity/v3/users/3a65ae3586344352818a2cdc114c9281 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:52.611760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.617087 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.619220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.641055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:52.642412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.734516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1088/2174] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:52.747030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.752840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.778275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:52.852261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9fda-cbc5-439b-810a-df89418616d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.859231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.859848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.860132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.860405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.871648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.873308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.885204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1087/2175] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:53.302762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.306531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.330978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b665-e9d7-476e-af28-a5ef2afc2723 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.339512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.340782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.341457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.341957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] PATH_INFO: `/v3/projects/12e2f573653e4ba48bb2ce04f5a0dc5a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.343842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e2f573653e4ba48bb2ce04f5a0dc5a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.346886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.350322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.352134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.390792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5add9-b486-43ae-a368-4936b719327a service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.397894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.399221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.400221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.400791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] PATH_INFO: `/v3/projects/f7926241cd4049fb866544bccee80a51` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.402149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7926241cd4049fb866544bccee80a51)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.404684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.421553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e2f573653e4ba48bb2ce04f5a0dc5a', 'request_id': 'req-122fee78-840d-41f4-935b-b2eaf7c93a91'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.432892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e2f573653e4ba48bb2ce04f5a0dc5a', 'request_id': 'req-122fee78-840d-41f4-935b-b2eaf7c93a91'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.442109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e2f573653e4ba48bb2ce04f5a0dc5a', 'request_id': 'req-122fee78-840d-41f4-935b-b2eaf7c93a91'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.460445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] The token cache is being invalidate because project 12e2f573653e4ba48bb2ce04f5a0dc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:53.460741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.461757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.464227 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7926241cd4049fb866544bccee80a51', 'request_id': 'req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.467594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1089/2176] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/projects/12e2f573653e4ba48bb2ce04f5a0dc5a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:53.467594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.469069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.470789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7926241cd4049fb866544bccee80a51', 'request_id': 'req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.477401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7926241cd4049fb866544bccee80a51', 'request_id': 'req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.492621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] The token cache is being invalidate because project f7926241cd4049fb866544bccee80a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:53.492918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.494356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.495876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1088/2177] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/projects/f7926241cd4049fb866544bccee80a51 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:53.499583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.500933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.544502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:53.548158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fee78-840d-41f4-935b-b2eaf7c93a91 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.572078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9b0e6-13d0-4f2b-a832-8a5e1d398eb8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.577602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.579047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.579380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.579658 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] PATH_INFO: `/v3/users/167f36b4be8b46e690ea805f40cf19fb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.580915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=167f36b4be8b46e690ea805f40cf19fb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.582968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.609982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.610352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.610635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.611154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] PATH_INFO: `/v3/users/7ac187ed46224b5db5be6d3d03e289cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.612625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac187ed46224b5db5be6d3d03e289cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.615273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.627689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:53.644328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167f36b4be8b46e690ea805f40cf19fb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.653808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167f36b4be8b46e690ea805f40cf19fb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.655006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167f36b4be8b46e690ea805f40cf19fb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.656070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167f36b4be8b46e690ea805f40cf19fb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.672103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167f36b4be8b46e690ea805f40cf19fb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.681959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac187ed46224b5db5be6d3d03e289cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.696056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac187ed46224b5db5be6d3d03e289cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.706932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1089/2178] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/users/167f36b4be8b46e690ea805f40cf19fb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:53.708401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.709612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac187ed46224b5db5be6d3d03e289cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.710313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.737271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac187ed46224b5db5be6d3d03e289cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.761089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac187ed46224b5db5be6d3d03e289cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:53.768919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1090/2179] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/users/7ac187ed46224b5db5be6d3d03e289cb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:53.770207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:53.772065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:53.820486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583b49-bbdb-439f-b672-6162f550cadf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.891735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a144d-8b29-4f09-98ce-20a5e46beccc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:53.897663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.899661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.900073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.900346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] PATH_INFO: `/v3/users/47de15dc16c54bcfa3ebf300fc590cff` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.901696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=47de15dc16c54bcfa3ebf300fc590cff)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.905450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.936350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:53.937341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:53.937868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:53.938299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] PATH_INFO: `/v3/users/2d9de4bf0e8e4e37907c73c73b7c4334` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:53.944816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9de4bf0e8e4e37907c73c73b7c4334)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:53.946213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:53.947755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.027712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47de15dc16c54bcfa3ebf300fc590cff'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.041898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47de15dc16c54bcfa3ebf300fc590cff'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.042662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47de15dc16c54bcfa3ebf300fc590cff'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.055904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47de15dc16c54bcfa3ebf300fc590cff'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.069242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9de4bf0e8e4e37907c73c73b7c4334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.078477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9de4bf0e8e4e37907c73c73b7c4334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.080016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9de4bf0e8e4e37907c73c73b7c4334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.081276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9de4bf0e8e4e37907c73c73b7c4334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.105682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:54.115555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9de4bf0e8e4e37907c73c73b7c4334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.117768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22a675e9-ef86-4ba5-b0fd-ed216e702a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47de15dc16c54bcfa3ebf300fc590cff'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.129047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1091/2180] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/users/47de15dc16c54bcfa3ebf300fc590cff => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.130852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.131467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.133287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.167059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:54.168193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.170357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1090/2181] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:53 2022] DELETE /identity/v3/users/2d9de4bf0e8e4e37907c73c73b7c4334 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.171966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.192329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.283114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1092/2182] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:54.285472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.287868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.304941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3231d-1227-4114-8661-7dad5fede4c5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.311419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.313003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.313355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.313732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] PATH_INFO: `/v3/projects/1205e93933d94ac8931f164748728ff4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.315019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1205e93933d94ac8931f164748728ff4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.316780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2ab3-4053-4937-af16-d92451fac9d0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.317311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.325323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.326345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.326736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.327460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] PATH_INFO: `/v3/users/9afb577f485044bf917be3a9327da113` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.328942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb577f485044bf917be3a9327da113)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.332006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.402308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1205e93933d94ac8931f164748728ff4', 'request_id': 'req-b678924a-4ca4-4662-a946-41e441d2fdb8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.409684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1205e93933d94ac8931f164748728ff4', 'request_id': 'req-b678924a-4ca4-4662-a946-41e441d2fdb8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.420372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1205e93933d94ac8931f164748728ff4', 'request_id': 'req-b678924a-4ca4-4662-a946-41e441d2fdb8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.424656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb577f485044bf917be3a9327da113'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.439363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb577f485044bf917be3a9327da113'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.440341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb577f485044bf917be3a9327da113'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.440963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb577f485044bf917be3a9327da113'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.441210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] The token cache is being invalidate because project 1205e93933d94ac8931f164748728ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:54.441602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.442343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.444631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1093/2183] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:54 2022] DELETE /identity/v3/projects/1205e93933d94ac8931f164748728ff4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.450685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.453082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.456869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb577f485044bf917be3a9327da113'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.503162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1091/2184] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:54 2022] DELETE /identity/v3/users/9afb577f485044bf917be3a9327da113 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.511744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.515667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.545198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:54.589740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678924a-4ca4-4662-a946-41e441d2fdb8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.601319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:54.606576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a14be-96e8-489f-8c20-18981b5cd1bb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.615550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.616831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.617753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.618111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] PATH_INFO: `/v3/users/7a8e6bdf372540f79cb796026cf77ef7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.619701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8e6bdf372540f79cb796026cf77ef7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.621955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.647375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.647995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.648444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.648771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.652077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.665980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.668394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.685033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1094/2185] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:54.685748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.687143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.696848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8e6bdf372540f79cb796026cf77ef7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.699466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c013d-bcf5-4af7-8587-44b21742a36b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.705993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8e6bdf372540f79cb796026cf77ef7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.706742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8e6bdf372540f79cb796026cf77ef7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.707365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8e6bdf372540f79cb796026cf77ef7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.713969 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.714631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.714876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.715226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] PATH_INFO: `/v3/projects/2d68175b72c4478db1804c25898e4858` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.716791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d68175b72c4478db1804c25898e4858)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.718249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-18943c7c-2927-4fe9-b64f-d73096426e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8e6bdf372540f79cb796026cf77ef7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.718765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.741978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1092/2186] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:54 2022] DELETE /identity/v3/users/7a8e6bdf372540f79cb796026cf77ef7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.744442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405343-08ae-4231-9d7f-6ddc86f27d6a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.744741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405343-08ae-4231-9d7f-6ddc86f27d6a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.744997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7405343-08ae-4231-9d7f-6ddc86f27d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.769123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d7405343-08ae-4231-9d7f-6ddc86f27d6a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:54.770382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d7405343-08ae-4231-9d7f-6ddc86f27d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.773874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d68175b72c4478db1804c25898e4858', 'request_id': 'req-ab38c6e0-845c-4a64-9ba7-b61c3393e106'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.783315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d68175b72c4478db1804c25898e4858', 'request_id': 'req-ab38c6e0-845c-4a64-9ba7-b61c3393e106'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.791159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d68175b72c4478db1804c25898e4858', 'request_id': 'req-ab38c6e0-845c-4a64-9ba7-b61c3393e106'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.807747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] The token cache is being invalidate because project 2d68175b72c4478db1804c25898e4858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:54.808488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.809398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:54.814971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1095/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:54 2022] DELETE /identity/v3/projects/2d68175b72c4478db1804c25898e4858 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:54.816091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.818039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.848839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1093/2188] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:54.851158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.851577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.851946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.873891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:54.874948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.894220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1094/2189] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:54.896577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:54.899059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.909906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c6e0-845c-4a64-9ba7-b61c3393e106 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.916281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:54.916872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.917597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.918133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] PATH_INFO: `/v3/projects/477290f100d44ebead142ddc568b2514` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.920279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477290f100d44ebead142ddc568b2514)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:54.922988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:54.945197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:54.988459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc232c-bec3-42a0-9dd2-29a637e1cf0c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:54.993562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477290f100d44ebead142ddc568b2514', 'request_id': 'req-e86f403b-081e-426f-b6be-4528365953b0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.001681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477290f100d44ebead142ddc568b2514', 'request_id': 'req-e86f403b-081e-426f-b6be-4528365953b0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.010531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477290f100d44ebead142ddc568b2514', 'request_id': 'req-e86f403b-081e-426f-b6be-4528365953b0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.032820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:55.045534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] The token cache is being invalidate because project 477290f100d44ebead142ddc568b2514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:55.045978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.046824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e86f403b-081e-426f-b6be-4528365953b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.049348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1096/2190] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:54 2022] DELETE /identity/v3/projects/477290f100d44ebead142ddc568b2514 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:55.050582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b65c-5b90-4fc7-bc37-643babe6327a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.050871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b65c-5b90-4fc7-bc37-643babe6327a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.051142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b65c-5b90-4fc7-bc37-643babe6327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.078788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c000b65c-5b90-4fc7-bc37-643babe6327a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:55.080039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c000b65c-5b90-4fc7-bc37-643babe6327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.095751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.096372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.096653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.096924 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.098741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.174054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1097/2191] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:55.175956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.176308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.176590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.200453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:55.201612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.219150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1098/2192] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:55.219380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.219474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.219474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.219605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.226392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa9ed9-4df0-4a3b-9738-b2b860fc742b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.233295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1095/2193] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:55.234711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.234865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.235578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.235825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.236153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] PATH_INFO: `/v3/projects/95afceb7e519491cae5b80e1546be9fa` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.239285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95afceb7e519491cae5b80e1546be9fa)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.241416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.249621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25413c0-8d19-4b43-8e6a-0497a1387624 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.284309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.285106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.285474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.285872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.286652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:55.287058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.288815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa3f3c-63c7-4ad3-9c15-8bca98cd88a7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.318561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1096/2194] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:55.320107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.320541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.320815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.348968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95afceb7e519491cae5b80e1546be9fa', 'request_id': 'req-c580fae3-184c-4a37-86be-06497d83fbf8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.351129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:55.357053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.357807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95afceb7e519491cae5b80e1546be9fa', 'request_id': 'req-c580fae3-184c-4a37-86be-06497d83fbf8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.367455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95afceb7e519491cae5b80e1546be9fa', 'request_id': 'req-c580fae3-184c-4a37-86be-06497d83fbf8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.388052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] The token cache is being invalidate because project 95afceb7e519491cae5b80e1546be9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:55.388449 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.389338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.391614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1099/2195] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:55 2022] DELETE /identity/v3/projects/95afceb7e519491cae5b80e1546be9fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:55.394792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.396695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.424366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:55.450202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1097/2196] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:55.451332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.452830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.478331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd051d3-8cd8-413f-88b2-0dce8af0c7b8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.484171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.484910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.485987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.485987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.486369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.488486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.497768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580fae3-184c-4a37-86be-06497d83fbf8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.502778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.503407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.503740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.504021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] PATH_INFO: `/v3/projects/9dafbe1498b2408988d9883a89708f51` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.505229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dafbe1498b2408988d9883a89708f51)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.507576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.530966 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1098/2197] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:55.535237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.536979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.585781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dafbe1498b2408988d9883a89708f51', 'request_id': 'req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.593260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dafbe1498b2408988d9883a89708f51', 'request_id': 'req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.602833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dafbe1498b2408988d9883a89708f51', 'request_id': 'req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.620642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] The token cache is being invalidate because project 9dafbe1498b2408988d9883a89708f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:55.621002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.621772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.624981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1100/2198] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:55 2022] DELETE /identity/v3/projects/9dafbe1498b2408988d9883a89708f51 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:55.627902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.630208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.631367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:55.655826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe0a64-6906-4cbd-a971-aeeaa90fb870 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.740112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.740773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.741050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.741318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] PATH_INFO: `/v3/users/85adccb337e8424a983bc386d43dfe7b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.742547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85adccb337e8424a983bc386d43dfe7b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.747162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.782590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16efe3e-9591-461f-bd60-7e3b8e61c8e8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.797933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.798684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.799069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.799422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.800408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:55.801649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.804233 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.826315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1101/2199] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:55.827190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.828910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.841264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85adccb337e8424a983bc386d43dfe7b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.844331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398aa60-98eb-46bb-a4e5-eb053a883126 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.849333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.849522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85adccb337e8424a983bc386d43dfe7b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.849968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.850098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85adccb337e8424a983bc386d43dfe7b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.850251 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.850506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.850669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85adccb337e8424a983bc386d43dfe7b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.851132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.853068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae4b7d-726f-4903-bdd3-81a0a681d99d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.858286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85adccb337e8424a983bc386d43dfe7b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:55.874496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1102/2200] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:55.875829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.876119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.876390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.878767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1099/2201] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:55 2022] DELETE /identity/v3/users/85adccb337e8424a983bc386d43dfe7b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:55.882478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.884588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.898984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:55.900784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.920400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:55.968798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301032b-b443-44b2-8391-0ef9ee4abacb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.974193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.975122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:55.975122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:55.975378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] PATH_INFO: `/v3/projects/cb22b8451d2c4174966fd2c15bee5367` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:55.984512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb22b8451d2c4174966fd2c15bee5367)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:55.984706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1103/2202] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:55.984706 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:55.984895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:55.985016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:55.992365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9fef9-e92c-43b3-9526-9edbee83f9a6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:55.996469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:55.998978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:55.999987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.000408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.000701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.001342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.003788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.043383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb22b8451d2c4174966fd2c15bee5367', 'request_id': 'req-90403bd0-2e62-4440-b593-843a112a74b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.044855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1104/2203] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:55 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:56.045791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.047823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.052326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb22b8451d2c4174966fd2c15bee5367', 'request_id': 'req-90403bd0-2e62-4440-b593-843a112a74b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.061774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb22b8451d2c4174966fd2c15bee5367', 'request_id': 'req-90403bd0-2e62-4440-b593-843a112a74b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.078674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] The token cache is being invalidate because project cb22b8451d2c4174966fd2c15bee5367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:56.079114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.080216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90403bd0-2e62-4440-b593-843a112a74b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.084881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1100/2204] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:55 2022] DELETE /identity/v3/projects/cb22b8451d2c4174966fd2c15bee5367 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:56.084881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e8ed-6962-4fa2-b56e-8c4f7ab1a399 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.084881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e8ed-6962-4fa2-b56e-8c4f7ab1a399 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.084881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e8ed-6962-4fa2-b56e-8c4f7ab1a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.110829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d00e8ed-6962-4fa2-b56e-8c4f7ab1a399 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.112073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d00e8ed-6962-4fa2-b56e-8c4f7ab1a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.141393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8eb5f-5c10-472b-be9c-1d092fb7cdad admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.146282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.146900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.147217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.147446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.148136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.149773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.162472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1105/2205] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:56.166291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.168443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.183000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c4c2-df1d-4b17-bdc9-c7279280d72e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.187669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.188280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.188561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.188836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.189557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.191137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1101/2206] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.192376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.192808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.193091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.194625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.216809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.217967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.222012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1106/2207] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:56.223064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.224813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.230890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1102/2208] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.231738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.242079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50a20-8d56-444a-8f4e-14502de4fe66 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.247997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.248614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.248874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.249151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.249845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.250630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb23f9-7a3c-4144-9f48-0f634e058722 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.251472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.255523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.256136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.256417 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.256688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.257342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:56.257695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.259889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.265588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1107/2209] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:56.265588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.274344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1103/2210] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:56.275845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.279701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.281832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bade-4d7f-463e-9a88-6a1300887624 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.286667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.287275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.287556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.287828 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.288648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.291492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027b638-da3e-4f20-b2ce-5ae199d348f2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.294013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777adb4-b398-4049-a123-1e7f34c0b272 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.298865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.299492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.299808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.300091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] PATH_INFO: `/v3/projects/f6778006842a47c6ba16468e698973cb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.301213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6778006842a47c6ba16468e698973cb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.304441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1108/2211] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:56.304441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.304441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.304441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.304801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.324044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.325261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.333385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1109/2212] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.334175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.343830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba47f-9451-478b-8452-ac9e2f864042 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.357965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6778006842a47c6ba16468e698973cb', 'request_id': 'req-e3d05563-80e6-4eab-8134-175f4c6a36c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.363591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6778006842a47c6ba16468e698973cb', 'request_id': 'req-e3d05563-80e6-4eab-8134-175f4c6a36c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.371262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6778006842a47c6ba16468e698973cb', 'request_id': 'req-e3d05563-80e6-4eab-8134-175f4c6a36c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.383712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] The token cache is being invalidate because project f6778006842a47c6ba16468e698973cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:56.384005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.384743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:56.386350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1104/2213] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:56 2022] DELETE /identity/v3/projects/f6778006842a47c6ba16468e698973cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:56.387113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.388401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.393588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:56.396592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:56.408916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.409613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.409901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.410181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] PATH_INFO: `/v3/projects/9b268f98bcec4e2a8196528ab5531dfd/users/049df06cc2454185b611ff75538f7877/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.424860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b268f98bcec4e2a8196528ab5531dfd, user_id=049df06cc2454185b611ff75538f7877, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.427554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.441587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1110/2214] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:56 2022] PUT /identity/v3/projects/9b268f98bcec4e2a8196528ab5531dfd/users/049df06cc2454185b611ff75538f7877/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:56.445741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.447720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.456678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d05563-80e6-4eab-8134-175f4c6a36c1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.513035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99dcbe-d41d-40e3-9094-0664aebee9d4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.514025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.514664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.514925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.515201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.515864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.517625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.517827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74635-0365-44fe-b8b0-0394c33a2afe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.518234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.518518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.518795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.519439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.521029 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.531350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1111/2215] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:56.532239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.533937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.545386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1105/2216] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:56.546782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.547071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.547351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.551060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421993bf-5a38-4c5e-bdf5-c6c457740a74 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.568744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.569652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.609656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.610439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.610821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.611201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.611919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:56.612228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.613875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb38ccc-9f25-4707-bcce-456617b1541e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.626473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1112/2217] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:56.627825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.628345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.628629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.633552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1106/2218] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.634790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.644628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a4576-4739-413c-b230-bd346c25b5cf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.649895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.650554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.650837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.651111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] PATH_INFO: `/v3/projects/4374ce709a5b407189dafd3978049ac4/users/0fab5b54c13e45b4b84e9b237725cd87/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.652343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.653633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.661259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1113/2219] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.662094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.671217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4374ce709a5b407189dafd3978049ac4, user_id=0fab5b54c13e45b4b84e9b237725cd87, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.672690 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd956a4-1933-490d-8e74-3461aff71902 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.674466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.677680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.678309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.678682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.679158 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.680175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.682914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe449e-6b53-479e-9d1b-7f092a4120a0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.692604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1107/2220] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:56 2022] PUT /identity/v3/projects/4374ce709a5b407189dafd3978049ac4/users/0fab5b54c13e45b4b84e9b237725cd87/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:56.693595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.707087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:56.716980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1114/2221] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/users => generated 285 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:56.716980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.717183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.717443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.736771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.738016 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.766795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3aa8-2751-4613-81aa-a35596d6ff10 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.773537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.774900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.775185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.775582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.776236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:56.776597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:56.779195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4406e8-b2f1-4ecd-aa40-1417a66f1199 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:56.814616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1115/2222] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.814616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.814616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.818438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1108/2223] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:56.819877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.820198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.820485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:56.857900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] MFA Rules not processed for user `0fab5b54c13e45b4b84e9b237725cd87`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:56.859141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:56.885768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ddb2-23a3-401f-a208-b974ef4a987a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:56.944010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1109/2224] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:56.946978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:56.958713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:56.959333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:56.959615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:56.959886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.036949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.038833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.040683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a5c1-a2a9-480b-b071-3482cb15b530 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.046705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.047596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.048437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.048806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.049992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.051993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.053761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1116/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:57.059455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.066069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1110/2226] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:57.067492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.074510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1512e6-ed8d-4239-a952-49c706121620 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.079593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.080163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dc20f-692e-4410-9584-883a8a36d649 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.080542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.080890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.081347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.082092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:57.088853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.088853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.089103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.089103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.089103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.089103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.089407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.089407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.103368 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1117/2227] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:57.104815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.109245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.119518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1111/2228] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:57 2022] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:57.119518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.127763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:57.133314 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff201c4-717d-4fcd-9893-8842d9f0025a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.146744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.148723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.150217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.150729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.152351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.156402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.183109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1112/2229] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:57.184126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.187851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:57.195283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46c3e3-3180-4f4b-b1f5-9b4e84f11f1d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.200655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.201359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.201688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.201952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.202569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.204887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.238942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67057-73d4-454f-a1fe-0f4436e685ae admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.240452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1113/2230] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:57 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:57.241431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.302091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.302761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.303043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.303309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.330902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6518774-1587-4b2e-aade-f0587ab7f19e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.339931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.340824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.341267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.341730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.343504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.345287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.361675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1114/2231] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:57.363043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.365065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.371539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.372821 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.382590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1118/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:57.383473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.395139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f3d28-9d00-4374-99ad-4b3f597697b5 service glance] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.402010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.402871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.403203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.403484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] PATH_INFO: `/v3/projects/954801aed5bf4f46b1b171c3e2cf4a02/users/5f6cc15289c7415a91150f0d8025a77d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.424984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954801aed5bf4f46b1b171c3e2cf4a02, user_id=5f6cc15289c7415a91150f0d8025a77d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.427847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.444929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c8f6-c11f-4b54-a466-fc1f08e7c276 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.447570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1119/2233] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:57 2022] PUT /identity/v3/projects/954801aed5bf4f46b1b171c3e2cf4a02/users/5f6cc15289c7415a91150f0d8025a77d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:57.448483 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.557603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.558241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.558702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.559645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.562240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.563115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987275c2-9115-4027-9c26-9f2b544aca14 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.572511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.573841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.574244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.574524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.575471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.580098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.594924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:57.619580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1120/2234] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:57 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:57.619580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.632462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:57.637418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbcf3d-cb20-48ed-888a-24bba22b1f94 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.645109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.647107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.647539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.647826 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.648493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.651526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08546c46-8abd-4164-9ee7-5c0e70c48668 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.664497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.664629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1121/2235] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:57.666722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.667185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.667473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.669908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.693550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1115/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:57.694632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.696789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:57.698640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.706016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ad7c4-09dc-40ee-b18a-45695f376c0c service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.719430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1122/2237] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:57.719647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.719647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.719647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.719647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.720072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.721168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.721963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.743593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3011-c3de-4e39-b9d2-92c557161aee None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.748856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1116/2238] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:57.749736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.756532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.757215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.757496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.757794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] PATH_INFO: `/v3/projects/743932bb4e6449a3a3e5a2a67f470e07/users/861ad1fb365840c6ba1b01a96758885c/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.782961 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=743932bb4e6449a3a3e5a2a67f470e07, user_id=861ad1fb365840c6ba1b01a96758885c, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.786257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.807318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1123/2239] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:57 2022] PUT /identity/v3/projects/743932bb4e6449a3a3e5a2a67f470e07/users/861ad1fb365840c6ba1b01a96758885c/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:57.808315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.892483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6facd-7bda-400b-9385-af2e741fbd5a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.944433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c97eb-e741-4866-9056-de927582cb9e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.959486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.960582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.961109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.961759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.964057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.969556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81eaf3-da6f-45ce-aaa6-1b2772ab1d10 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.989352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.990068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.990414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.990673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.005228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:58.007976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:58.016053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1124/2240] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:58.016053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.016053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.016053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.031016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1117/2241] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:58.031826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:58.089534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed35b-cd98-4af5-9ef1-6a2f19d58f57 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:58.102135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:58.104111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] MFA Rules not processed for user `861ad1fb365840c6ba1b01a96758885c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:58.105497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:58.107596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.108230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.108512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] PATH_INFO: `/v3/projects/7be8346257e141a2b13121cc35273027/users/8b1b3f43a89c48fb88d09d6dbce1f2ea/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.164224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be8346257e141a2b13121cc35273027, user_id=8b1b3f43a89c48fb88d09d6dbce1f2ea, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:58.174841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb4728-441b-4756-9d32-06b3f11a3ae2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:58.209601 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1118/2242] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:58 2022] PUT /identity/v3/projects/7be8346257e141a2b13121cc35273027/users/8b1b3f43a89c48fb88d09d6dbce1f2ea/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:58.211311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.212133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.212409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.238850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1125/2243] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:58.253061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:58.262424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] MFA Rules not processed for user `8b1b3f43a89c48fb88d09d6dbce1f2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:58.263653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:58.305796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:58.344234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af925b-19d0-40b3-ab6e-4cd695f0f1c8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:58.418416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:58.464717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1119/2244] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:58.476036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:58.477980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.478473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.478933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.518132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:58.649413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5164-111f-43e8-a188-341326e5ff3e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:58.651962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:58.653438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:58.654055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:58.655842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.656698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.656698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.667635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1126/2245] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:58.682089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:58.683777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965e722-f999-4cf7-9649-584900c0c709 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:58.705082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1120/2246] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:58.721774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:58.867677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3608c6-eff6-4fe8-8e75-0c7db4fa5634 service glance] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:58.883490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:58.884516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:58.886281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:58.886281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] PATH_INFO: `/v3/users/8b1b3f43a89c48fb88d09d6dbce1f2ea` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:58.886500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1b3f43a89c48fb88d09d6dbce1f2ea)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:58.888383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:58.985745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:58.988895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1b3f43a89c48fb88d09d6dbce1f2ea'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:59.006695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1b3f43a89c48fb88d09d6dbce1f2ea'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:59.007785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1b3f43a89c48fb88d09d6dbce1f2ea'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:59.018736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1b3f43a89c48fb88d09d6dbce1f2ea'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:59.064652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1b3f43a89c48fb88d09d6dbce1f2ea'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:59.074843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1127/2247] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:58 2022] DELETE /identity/v3/users/8b1b3f43a89c48fb88d09d6dbce1f2ea => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:59.076457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4f76-0206-4c7d-af1d-a3598eb74bc8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:59.076854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4f76-0206-4c7d-af1d-a3598eb74bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:59.077361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4f76-0206-4c7d-af1d-a3598eb74bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:59.124337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-35eb4f76-0206-4c7d-af1d-a3598eb74bc8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:59.125644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-35eb4f76-0206-4c7d-af1d-a3598eb74bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:59.214803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1121/2248] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:59.238132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:59.239677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:59.374326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf4da6-f8e9-4aa2-991e-67346dd7b7a8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:59.382003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:59.382621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:59.382906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:59.383315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:59.417221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:59.419985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:59.434075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1128/2249] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:59.750896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:59.751485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:59.751770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:59.835560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] MFA Rules not processed for user `5f6cc15289c7415a91150f0d8025a77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:59.847556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:59.975700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1122/2250] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:12:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:59.989521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:59.991047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:00.195659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08b0b-06fe-4df8-bb44-b8a6810be624 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:00.218357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:00.219717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.220200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.220665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.233441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:00.235922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388f56-b27e-49f2-87da-4a572d75a229 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:00.255057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1129/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:00.270259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:00.273135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:00.335379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b83e3-57b5-4eee-b9c9-184fca4dc7ba None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:00.342370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:00.343121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.343498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.343872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] PATH_INFO: `/v3/projects/7be8346257e141a2b13121cc35273027` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.345668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be8346257e141a2b13121cc35273027)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:00.350270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:00.385878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:00.460076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be8346257e141a2b13121cc35273027', 'request_id': 'req-565cd868-7006-44bd-9a96-23140f84a7c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:00.466956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be8346257e141a2b13121cc35273027', 'request_id': 'req-565cd868-7006-44bd-9a96-23140f84a7c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:00.478142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be8346257e141a2b13121cc35273027', 'request_id': 'req-565cd868-7006-44bd-9a96-23140f84a7c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:00.504590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] The token cache is being invalidate because project 7be8346257e141a2b13121cc35273027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:00.505443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:00.507627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-565cd868-7006-44bd-9a96-23140f84a7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:00.513524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1123/2252] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:00 2022] DELETE /identity/v3/projects/7be8346257e141a2b13121cc35273027 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:00.515401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.515725 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.516003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.565990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:00.567407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:00.738963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1130/2253] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:00.740071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.740528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.740818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.780104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:00.782204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:00.794212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1124/2254] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:00.799485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:00.818999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4c4a8-0e42-43cb-995c-78b5c6794868 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:00.825431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:00.826168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.826511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.828055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.828055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:00.828055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:00.829540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:00.832853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:00.855412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:00.856201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1131/2255] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:00.869092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db86b04-1a59-4823-bf43-c426eba7d6ef None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:00.876129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:00.876811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:00.877102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:00.878495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:00.879231 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:00.885705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:00.953217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:00.961591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1125/2256] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:00 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:00.967378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cdc1-b721-4545-93ec-50e8e2d6d040 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:01.066249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:01.069655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.070136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.071408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.072654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:01.075101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:01.115598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1132/2257] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:00 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:01.116928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:01.129793 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5106-e5bf-4ede-bb18-7702f2a563ed admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:01.150458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:01.151381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.151764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.152141 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.152921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:01.154738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:01.169497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1126/2258] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:01.170766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:01.182708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7264-c509-4f6d-a751-03907c033e7e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:01.192036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:01.193470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.195069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.195805 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.198652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:01.201243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbed7a-1da2-4779-b104-e4b3fb66b10e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:01.225055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1133/2259] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:01.225737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:01.239667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ff91b-db6e-48de-abe1-c087edfaaa86 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:01.249144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:01.249898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.250808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.250808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] PATH_INFO: `/v3/projects/1c0d0749d2884d85ac065d8efd9b7522/users/3e88df413e7c40d5914a7b6f864a55a0/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.274000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0d0749d2884d85ac065d8efd9b7522, user_id=3e88df413e7c40d5914a7b6f864a55a0, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:01.276798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:01.294192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1127/2260] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:01 2022] PUT /identity/v3/projects/1c0d0749d2884d85ac065d8efd9b7522/users/3e88df413e7c40d5914a7b6f864a55a0/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:01.307239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5b29-c66b-480a-b14d-76ec060e6091 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.307574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5b29-c66b-480a-b14d-76ec060e6091 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.307758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5b29-c66b-480a-b14d-76ec060e6091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.343080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f8ef5b29-c66b-480a-b14d-76ec060e6091 None None] MFA Rules not processed for user `3e88df413e7c40d5914a7b6f864a55a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:01.344445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f8ef5b29-c66b-480a-b14d-76ec060e6091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:01.465667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1134/2261] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:01.476816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:01.478875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:01.546256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e957-a288-44ed-bd2a-70d8418029f0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:01.562810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:01.563556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:01.563847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:01.564123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:01.577258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:01.578454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcc87d-219f-4016-9d42-55a9d3ce4093 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:01.591218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1128/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:02.102008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211698-44d6-472e-aad5-1e44eeb2e480 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:02.102875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211698-44d6-472e-aad5-1e44eeb2e480 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:02.103273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211698-44d6-472e-aad5-1e44eeb2e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:02.155627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3c211698-44d6-472e-aad5-1e44eeb2e480 None None] MFA Rules not processed for user `5f6cc15289c7415a91150f0d8025a77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:02.156979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3c211698-44d6-472e-aad5-1e44eeb2e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:02.281276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1135/2263] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:03.186116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:03.186654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:03.186874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:03.243370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] MFA Rules not processed for user `3e88df413e7c40d5914a7b6f864a55a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:03.244607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:03.256458 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1129/2264] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:04.014670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6c70-b51e-4b50-8dc9-7c3af1871a13 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.015130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6c70-b51e-4b50-8dc9-7c3af1871a13 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.015274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6c70-b51e-4b50-8dc9-7c3af1871a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.054491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:04.067713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b37f6c70-b51e-4b50-8dc9-7c3af1871a13 None None] MFA Rules not processed for user `049df06cc2454185b611ff75538f7877`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:04.070183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b37f6c70-b51e-4b50-8dc9-7c3af1871a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.148048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1136/2265] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:13.216821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:14.144813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=28 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:16.084717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.086577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.226276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491d8be-32ca-498f-bc54-3c735a8ada90 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.236460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.237462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.238010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.238200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.266160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.266160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05fce5-7d5e-4c0e-8388-c092d7ca069d service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.293720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1130/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:17.881138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c760178-18ef-4952-935e-2a8ea6769364 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.881670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c760178-18ef-4952-935e-2a8ea6769364 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.881670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c760178-18ef-4952-935e-2a8ea6769364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.901031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4c760178-18ef-4952-935e-2a8ea6769364 None None] MFA Rules not processed for user `049df06cc2454185b611ff75538f7877`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.902280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4c760178-18ef-4952-935e-2a8ea6769364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.909316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1137/2267] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:20.158353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.160128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.160703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.163483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1131/2268] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:13:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:13:20.175414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.176004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.176004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.224020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:20.225269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:20.280717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.283619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:20.385749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7f30-9b36-4059-aa76-42b571339446 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.387346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1138/2269] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:20.391322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.392081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.392613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.393130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] PATH_INFO: `/v3/users/2b4a8b73367e4e369f5c9655d5e7cd7f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.394871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4a8b73367e4e369f5c9655d5e7cd7f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.397639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.403262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.408154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:20.425546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db934d8-da40-44fe-9d7c-0f9f98461a1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.433333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.434389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.434909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.435372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.450753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.453331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.468152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1139/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:20.493033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4a8b73367e4e369f5c9655d5e7cd7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:20.510220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4a8b73367e4e369f5c9655d5e7cd7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:20.510976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4a8b73367e4e369f5c9655d5e7cd7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:20.511960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4a8b73367e4e369f5c9655d5e7cd7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:20.520993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4a8b73367e4e369f5c9655d5e7cd7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:20.547620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1132/2271] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:20 2022] DELETE /identity/v3/users/2b4a8b73367e4e369f5c9655d5e7cd7f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:20.788543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.803907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429ded3-4474-4f13-a155-a5f3428511df service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.931649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.933939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.935270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.935561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] PATH_INFO: `/v3/projects/e8b8ddfdb91b41e2a629f1b69e47c9fd` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.939200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b8ddfdb91b41e2a629f1b69e47c9fd)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.941359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.017779 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b8ddfdb91b41e2a629f1b69e47c9fd', 'request_id': 'req-2a1dd7da-b009-47f5-9276-2c7547e395fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.035720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b8ddfdb91b41e2a629f1b69e47c9fd', 'request_id': 'req-2a1dd7da-b009-47f5-9276-2c7547e395fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.044310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b8ddfdb91b41e2a629f1b69e47c9fd', 'request_id': 'req-2a1dd7da-b009-47f5-9276-2c7547e395fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.063620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] The token cache is being invalidate because project e8b8ddfdb91b41e2a629f1b69e47c9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:21.063924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.065965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.068299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1140/2272] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:20 2022] DELETE /identity/v3/projects/e8b8ddfdb91b41e2a629f1b69e47c9fd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:21.072905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.074779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.088268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.094452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b568ae-e308-4e33-93b5-38917256d2a3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.194418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.198582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.198963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.200937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] PATH_INFO: `/v3/users/8a71f434e3a94e7398cf99ca75476899` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.203876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a71f434e3a94e7398cf99ca75476899)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.208115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.280122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a71f434e3a94e7398cf99ca75476899'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.287526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a71f434e3a94e7398cf99ca75476899'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.288568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a71f434e3a94e7398cf99ca75476899'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.289293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a71f434e3a94e7398cf99ca75476899'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.321930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9eb41-37ee-489e-846a-b5423bdca7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a71f434e3a94e7398cf99ca75476899'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.373754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.378868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.389819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1133/2273] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:21 2022] DELETE /identity/v3/users/8a71f434e3a94e7398cf99ca75476899 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:21.398956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dd7da-b009-47f5-9276-2c7547e395fa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.410834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.501949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.502726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.503275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.503659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] PATH_INFO: `/v3/users/0fab5b54c13e45b4b84e9b237725cd87` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.505153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fab5b54c13e45b4b84e9b237725cd87)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.507315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.598945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fab5b54c13e45b4b84e9b237725cd87'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.611926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fab5b54c13e45b4b84e9b237725cd87'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.613245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fab5b54c13e45b4b84e9b237725cd87'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.629181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fab5b54c13e45b4b84e9b237725cd87'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.650161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fab5b54c13e45b4b84e9b237725cd87'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:21.677999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1141/2274] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:21 2022] DELETE /identity/v3/users/0fab5b54c13e45b4b84e9b237725cd87 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:21.683076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.683076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.683350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.715138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:21.716677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.802324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1134/2275] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:21.825660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.827103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.948309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949120-a903-4958-8db8-17fdfa58ddb2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.956163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.957150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.957444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.958300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.973555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.988641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403b5b-0fde-4fe3-b2cf-6437f7122053 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.004737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1142/2276] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:22.240547 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.243262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.261249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f6139-7293-44fa-b5cd-f1b749534c1f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.280477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.281137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.281473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.281782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] PATH_INFO: `/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.284832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeda69e3af04c78902fbbf2e15c2eed)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.299917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.354828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:22.401868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeda69e3af04c78902fbbf2e15c2eed', 'request_id': 'req-b2994700-c259-4f8f-9a86-efca3ea0abd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.409041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeda69e3af04c78902fbbf2e15c2eed', 'request_id': 'req-b2994700-c259-4f8f-9a86-efca3ea0abd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.416905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeda69e3af04c78902fbbf2e15c2eed', 'request_id': 'req-b2994700-c259-4f8f-9a86-efca3ea0abd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.435044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] The token cache is being invalidate because project 3eeda69e3af04c78902fbbf2e15c2eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:22.435347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.436071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b2994700-c259-4f8f-9a86-efca3ea0abd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.439459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1135/2277] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:22 2022] DELETE /identity/v3/projects/3eeda69e3af04c78902fbbf2e15c2eed => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:22.443901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.444317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.444507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.487498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:22.488928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.561226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:22.657693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1143/2278] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:22.664755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.665264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.665574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.694640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:22.696344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.711818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1136/2279] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:22.713938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.727182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c6263-ebec-4b08-9961-3ec93d43af68 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.733175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.733939 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.734282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.734480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.735184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:22.735489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.737131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.756156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1144/2280] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:22.758132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.768796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75836d80-acab-4ff2-9c4b-db1278b0c28d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.776849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.777556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.777768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.778036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.779104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.780562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.817563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1137/2281] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:22 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:22.820134 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.850751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b527-b189-4d94-8b7a-5961e24e678c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.943388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.946758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.947090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.947371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.948043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.950066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.983116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.986301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1145/2282] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:22 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:22.997399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf63ba-0ce5-42e1-be0d-387bd83e9168 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.004593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.005636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.007079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.007677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.008948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.011361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.026519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1138/2283] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:23.027741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.040011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965bff-ce64-4743-a565-b0509bf204c6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.058112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.058790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.059085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.059488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.060352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.063770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5029b0-8a09-4557-88a9-4aa168c64881 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.085067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.110379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1146/2284] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:23.113263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc5d72-b4da-4a2b-8ef3-46de3800fcf2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.119406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.120023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.120396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.120774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] PATH_INFO: `/v3/projects/8da57ef8ccb7411da0bdb8bffce84ef3/users/0893051c3043435481067cb93bd59387/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.140473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da57ef8ccb7411da0bdb8bffce84ef3, user_id=0893051c3043435481067cb93bd59387, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.143881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.171992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1139/2285] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:23 2022] PUT /identity/v3/projects/8da57ef8ccb7411da0bdb8bffce84ef3/users/0893051c3043435481067cb93bd59387/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:23.183225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.183527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.183769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.225999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] MFA Rules not processed for user `0893051c3043435481067cb93bd59387`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:23.227882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.353237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1147/2286] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:23.366046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.368165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.446322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aea81-9cca-4468-bb6d-4badfe206210 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.451062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.451689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.452022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.452297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.467609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.468897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72b8-126e-4a62-a28c-dbe6d93c9b0f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.501389 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1140/2287] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:23.665928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.671209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.769922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:23.845732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bee2e-fe8d-453f-9d91-54e6b1e7bb7c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.850714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.851507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.851887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.852546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] PATH_INFO: `/v3/projects/4374ce709a5b407189dafd3978049ac4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.854278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4374ce709a5b407189dafd3978049ac4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.856045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.917431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4374ce709a5b407189dafd3978049ac4', 'request_id': 'req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.925823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4374ce709a5b407189dafd3978049ac4', 'request_id': 'req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.939331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4374ce709a5b407189dafd3978049ac4', 'request_id': 'req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.966791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] The token cache is being invalidate because project 4374ce709a5b407189dafd3978049ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:23.967191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.968438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5cccc280-0fc7-4cbb-a40f-754380a2d0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.970504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1148/2288] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:23 2022] DELETE /identity/v3/projects/4374ce709a5b407189dafd3978049ac4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:23.975386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.975859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.976309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.032212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:24.035879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:24.172376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:24.224029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1141/2289] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:24.231660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.232221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.232643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.286432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:24.292600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:24.324224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1149/2290] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:24.325296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.340010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c43457-4d8a-4ab0-9e49-0c3214d9410e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.364285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.364831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.365104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.365375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.370422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:24.371092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.372652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.397591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1142/2291] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:24.399446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.416847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4c5fe-5a79-4d99-a49d-43de5951383e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.424466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.425199 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.425632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.425913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.427175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.432643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.494488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1150/2292] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:24.498725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.528373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd05b-3fef-4153-9197-c54486b302ec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.676996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.677726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.678083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.678426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.679750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.682021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.722855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1143/2293] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:24 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:24.723425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.739482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd944f-614e-4deb-b91e-6083f93cc121 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.751506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.752276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.752627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.753264 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.754445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.757389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.777473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.778319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1151/2294] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:24.790811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3b16-519f-45ba-93fc-0312917c0884 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.796240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.797016 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.797312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.797748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.798890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.800796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae4290-dccc-4dad-978f-b9d10ffffb22 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.816288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1144/2295] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:24.820848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.831615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ebdb9-f684-43de-a575-608feacb4379 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.837424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.838459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.838744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.839119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] PATH_INFO: `/v3/projects/a1939cbc6c42449198bc7cd92ac935d7/users/e16d9343fbe44410a4201d87d3ceb8fd/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.856400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1939cbc6c42449198bc7cd92ac935d7, user_id=e16d9343fbe44410a4201d87d3ceb8fd, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.859803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.904323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1152/2296] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:24 2022] PUT /identity/v3/projects/a1939cbc6c42449198bc7cd92ac935d7/users/e16d9343fbe44410a4201d87d3ceb8fd/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:24.915872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.916749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.917199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.960600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] MFA Rules not processed for user `e16d9343fbe44410a4201d87d3ceb8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:24.962780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.050457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1145/2297] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:25.071645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.073732 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.147307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0bcd4-33aa-4013-8bcb-576e200af3d3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.152218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.152553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.152835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.153491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.158847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:25.163260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.165162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45b847-e21a-44e2-b4b1-dcbc32277176 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.197543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1153/2298] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:27.182060 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.183752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.245546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:27.262578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607ae-623f-4a9d-b0b8-0e8000225ee1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.267754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.268506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.269030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.269405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] PATH_INFO: `/v3/users/0893051c3043435481067cb93bd59387` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.270838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0893051c3043435481067cb93bd59387)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.272934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.342506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0893051c3043435481067cb93bd59387'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.352058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0893051c3043435481067cb93bd59387'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.352865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0893051c3043435481067cb93bd59387'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.353822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0893051c3043435481067cb93bd59387'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.363420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0893051c3043435481067cb93bd59387'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.381954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1146/2299] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:27 2022] DELETE /identity/v3/users/0893051c3043435481067cb93bd59387 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:27.387238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.387726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.387818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.407117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:27.408324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.490723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1154/2300] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:27.509003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.511396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.590725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2c0d-c336-45c1-a67e-7d4b46861f8c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.595008 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.595908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.596375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.596825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.609425 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.610961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.621228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1147/2301] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:27.887906 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.889532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.903839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033d54-24e7-4add-b9bb-d1273ab0b8dc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.908360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.909002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.909373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.909678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] PATH_INFO: `/v3/projects/8da57ef8ccb7411da0bdb8bffce84ef3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.910807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da57ef8ccb7411da0bdb8bffce84ef3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.912709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.965479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da57ef8ccb7411da0bdb8bffce84ef3', 'request_id': 'req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.967012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.968645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.974059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da57ef8ccb7411da0bdb8bffce84ef3', 'request_id': 'req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.988803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f14a51-642c-4e3c-a7d9-c4ce0b8e60cf service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.990075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da57ef8ccb7411da0bdb8bffce84ef3', 'request_id': 'req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.006572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] The token cache is being invalidate because project 8da57ef8ccb7411da0bdb8bffce84ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:28.006884 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.008136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6027b1bb-e539-46c7-bc5c-2900bddf9d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.013611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1155/2302] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:27 2022] DELETE /identity/v3/projects/8da57ef8ccb7411da0bdb8bffce84ef3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:28.017380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d433-bfe6-4a75-a0db-a9e84f664409 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.021742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d433-bfe6-4a75-a0db-a9e84f664409 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.022136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d433-bfe6-4a75-a0db-a9e84f664409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.051775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5c81d433-bfe6-4a75-a0db-a9e84f664409 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.053943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5c81d433-bfe6-4a75-a0db-a9e84f664409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.090605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.094464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.095087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.095427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] PATH_INFO: `/v3/users/e16d9343fbe44410a4201d87d3ceb8fd` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.105778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16d9343fbe44410a4201d87d3ceb8fd)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.109078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.124074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.168378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1156/2303] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:28.176055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.176428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.176775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.202832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16d9343fbe44410a4201d87d3ceb8fd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.214383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16d9343fbe44410a4201d87d3ceb8fd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.215897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16d9343fbe44410a4201d87d3ceb8fd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.216693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16d9343fbe44410a4201d87d3ceb8fd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.224035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.225050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.229456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c114aae-82ae-4c04-bb34-b767083aa288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16d9343fbe44410a4201d87d3ceb8fd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.238691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1157/2304] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:28.240471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.256203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27942651-ed95-40f7-830a-7edbd71b4ebd None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.262741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.263812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.264278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.264752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.265349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1148/2305] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:27 2022] DELETE /identity/v3/users/e16d9343fbe44410a4201d87d3ceb8fd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:28.266237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:28.266724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.266853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.267147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.267560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.269226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.282240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.293892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1158/2306] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:28.295118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.310764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.311989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.312619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ede6c-33fe-4a8a-8aaa-244732bc67ab admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.404972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.406524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.407089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.407578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.408451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.411903 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.444375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1149/2307] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:28.456682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1159/2308] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:28.462005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.475381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.476763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d57f-7547-438f-af44-65e4225476ef None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.478268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.613303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279334-cdf0-4783-8e0c-c05baf0b845b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.615982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.616117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.616307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.619325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.620043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.624264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.634889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.635371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.635655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.635926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.651305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.653032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.674288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1150/2309] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:28.675788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.684142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1160/2310] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:28.696280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3fa5-d03e-4a78-9760-4d675132ac35 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.706347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.707022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.707304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.711297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.712128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.714082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.731649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1151/2311] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:28.736525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.751736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbf6bf-a742-49ac-8979-60dcc37acb48 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.760539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.761327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.761703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.762045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.762808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.764680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b1494-cdda-49ae-b0ec-b359c61b06ad admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.780096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1161/2312] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:28.782246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.788010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.800405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51065a-3ffa-4555-bbbd-a9ecf1fb238b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.813099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.814396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.815557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.816035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] PATH_INFO: `/v3/projects/878b2adb68fa4b00856fdb4cef7dc641/users/571bdb03b67f432d8119cc1c75d8c85c/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.840448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878b2adb68fa4b00856fdb4cef7dc641, user_id=571bdb03b67f432d8119cc1c75d8c85c, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.843783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.872301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1152/2313] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:28 2022] PUT /identity/v3/projects/878b2adb68fa4b00856fdb4cef7dc641/users/571bdb03b67f432d8119cc1c75d8c85c/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:28.887119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.887513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.887899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.951968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] MFA Rules not processed for user `571bdb03b67f432d8119cc1c75d8c85c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.954409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.039664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1162/2314] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:29.043694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.149477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e6cbd-778a-496c-a5a8-a502188f26f7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.163975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.164717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.165122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.165714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.166472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.169730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.213740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1153/2315] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:29.217693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.225744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.232126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01127e-87cb-4e7e-8387-b387507c08b9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.301331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.303149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.303593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.304124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.305293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.308473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.337685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1163/2316] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:29.346100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.358258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf2c29-301b-47cb-ab45-e835ce3e936c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.364402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.365392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.365828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.366233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.367307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.369375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.388673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1154/2317] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:29.389895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.400904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10426c8-a455-4fb8-8e6c-a618d46a0abe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.405883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.406529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.406854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.407150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.407839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.409702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa839395-7f8c-4151-ace4-527c3a78532d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.425192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1164/2318] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:29.426996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.437410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c21c-e9eb-41ba-b72b-6f45b48218ed admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.442216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.442880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.443160 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.443435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] PATH_INFO: `/v3/projects/6f0bc6b1e51a4ed29eda3937900030fa/users/895187f022b4491294061658d58cc455/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.458886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0bc6b1e51a4ed29eda3937900030fa, user_id=895187f022b4491294061658d58cc455, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.462324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.476694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1155/2319] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:29 2022] PUT /identity/v3/projects/6f0bc6b1e51a4ed29eda3937900030fa/users/895187f022b4491294061658d58cc455/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:29.487061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.487398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.487678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.518275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] MFA Rules not processed for user `895187f022b4491294061658d58cc455`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:29.519737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.551811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.553667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.605281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1165/2320] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:29.610209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.632705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d8be-011a-4b12-9708-cce73f948931 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.644445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.645834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.646191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.646399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] PATH_INFO: `/v3/projects/a1939cbc6c42449198bc7cd92ac935d7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.648024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1939cbc6c42449198bc7cd92ac935d7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.650361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.703996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b892-aeda-46b5-b2f4-1b684ef14b7d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.709995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.710998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.711625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.711867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.712606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.715753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.718039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.743743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.754197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1166/2321] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:29.755622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1939cbc6c42449198bc7cd92ac935d7', 'request_id': 'req-17016418-bb14-4398-add0-315bee7dcfe3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.758920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.763032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1939cbc6c42449198bc7cd92ac935d7', 'request_id': 'req-17016418-bb14-4398-add0-315bee7dcfe3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.770354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1939cbc6c42449198bc7cd92ac935d7', 'request_id': 'req-17016418-bb14-4398-add0-315bee7dcfe3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.787020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] The token cache is being invalidate because project a1939cbc6c42449198bc7cd92ac935d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:29.787020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.787732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.789798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1156/2322] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:29 2022] DELETE /identity/v3/projects/a1939cbc6c42449198bc7cd92ac935d7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:29.856014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af834a-5c87-49b3-94ae-111cca24b2b0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.862490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.864007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.864287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.864561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.865695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.867819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.906333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1167/2323] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:29.910729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.912236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.019220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17016418-bb14-4398-add0-315bee7dcfe3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.024397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.025043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.025324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.025629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.026277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.027932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.042390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1157/2324] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:30.043674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.053818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cb54c-483a-42d2-8d4f-9b79e5f32e4a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.059992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.060660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.060937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.061208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] PATH_INFO: `/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2/users/b80a4afe35a24a8eacec047643cf547d/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.076432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e11cdf30af4575b2514ba7e6d47ba2, user_id=b80a4afe35a24a8eacec047643cf547d, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.079123 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.094004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1168/2325] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:30 2022] PUT /identity/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2/users/b80a4afe35a24a8eacec047643cf547d/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:30.096879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.107819 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c702f-567a-409b-87d0-bc01b4306ddf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.164634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.165262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.165574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.165848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.166499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.168250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736ad56-b816-4b34-b8e6-ef08da29b8df admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.181855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1158/2326] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:30.183519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.193924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61144409-bd4f-4797-ad16-798e9b76f6aa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.198643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.199300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.199581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.199851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] PATH_INFO: `/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2/users/b80a4afe35a24a8eacec047643cf547d/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.201797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e11cdf30af4575b2514ba7e6d47ba2, user_id=b80a4afe35a24a8eacec047643cf547d, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.204445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.223088 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1169/2327] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:30 2022] PUT /identity/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2/users/b80a4afe35a24a8eacec047643cf547d/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:30.233999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.234515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.234608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.265942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] MFA Rules not processed for user `b80a4afe35a24a8eacec047643cf547d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:30.267239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.317926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:30.368715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1159/2328] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:30.380430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.382589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.461650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65d0b8-b3bf-4bd0-80d7-5329cf1152f8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.467298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.467965 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.468285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.469078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.470452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.538023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.539666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f628a68-7527-4689-9081-b04c97e11876 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.553321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1170/2329] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:32.028464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.029921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.102119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f527d-823d-46d1-aabe-c204feef8a61 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.107636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.108255 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.108617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.108916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] PATH_INFO: `/v3/users/861ad1fb365840c6ba1b01a96758885c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.110212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=861ad1fb365840c6ba1b01a96758885c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.112536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.168995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861ad1fb365840c6ba1b01a96758885c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.176787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861ad1fb365840c6ba1b01a96758885c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.177558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861ad1fb365840c6ba1b01a96758885c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.178235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861ad1fb365840c6ba1b01a96758885c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.187551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861ad1fb365840c6ba1b01a96758885c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.213461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1160/2330] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:32 2022] DELETE /identity/v3/users/861ad1fb365840c6ba1b01a96758885c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:32.216067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.216584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.217021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.228330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:32.246599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:32.248093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.250276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.251641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.323079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ba7b-d3dc-4c5f-8dc8-b4db461c41dd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.326731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.327345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.327627 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.327898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.329738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.340064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1171/2331] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:32.340363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:32.352609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.354802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.402812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.404414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.414713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1161/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:32.417713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b1fc-4d59-4227-bef9-57bc61978288 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.421496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.422137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.422419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.422691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.432810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.434321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b07e4-598b-46da-94b2-195ce0572c98 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.447096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1172/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:32.798193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.799836 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.832070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0c8a-1bd0-48ae-81d6-c1deb10fafab service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.837221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.838323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.838610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.838887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] PATH_INFO: `/v3/projects/743932bb4e6449a3a3e5a2a67f470e07` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.840082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743932bb4e6449a3a3e5a2a67f470e07)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.843224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.960996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743932bb4e6449a3a3e5a2a67f470e07', 'request_id': 'req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.969813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743932bb4e6449a3a3e5a2a67f470e07', 'request_id': 'req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.978091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743932bb4e6449a3a3e5a2a67f470e07', 'request_id': 'req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.993422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] The token cache is being invalidate because project 743932bb4e6449a3a3e5a2a67f470e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:32.993825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.994448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-35d56cbf-eb20-4a0e-9c79-2077fcda9e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.997872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1162/2334] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:32 2022] DELETE /identity/v3/projects/743932bb4e6449a3a3e5a2a67f470e07 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:33.004155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.004665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.005122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.037836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.040342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.171669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1173/2335] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:33.182057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.182567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.182654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.189421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.191162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.211169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.212484 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.222032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1163/2336] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:33.226345 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.237463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4e367-0962-44fb-a547-c71f2d6b41bf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.243441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.244238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.244586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.245013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.245875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:33.246479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.248392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.270435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1164/2337] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:33.274244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.302224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6707-bed4-4479-9196-dd7eb3107499 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.303783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.309781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd3de2-98cb-4913-88fe-2509ba051fce None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.313332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.314035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.314351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.314633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.315292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.317615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.323173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.323814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.324094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.324365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.340646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.391820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1165/2338] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:33.395600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.456997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.460651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.506851 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1174/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:33.528926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.548056 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d953c-5ff3-49ee-9295-9e2a46af37a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.559727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.560562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.560976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.561959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.563220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.567218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.621072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1166/2340] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:33.622609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.635048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f39f-b178-4d4d-8788-378871487268 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.646274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.648280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.648880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.649496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.650513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.653861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.671912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1175/2341] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:33.675959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.716953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0fe3b-e95f-4fad-99f1-d57db53c5fd0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.725091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.726784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.727076 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.727493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.728175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.730143 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d04eb-ba4e-4b32-b028-42224e30d24a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.741460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1167/2342] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:33.746793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.766784 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e169-95ce-4642-928b-917d42f8af6c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.772344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.773872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.774186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.774482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] PATH_INFO: `/v3/projects/63de4bbc978049b08090fc6226c84378/users/88c4f4ce799b4bdcafd935f927f0519b/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.794130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63de4bbc978049b08090fc6226c84378, user_id=88c4f4ce799b4bdcafd935f927f0519b, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.797396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.822284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1176/2343] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:33 2022] PUT /identity/v3/projects/63de4bbc978049b08090fc6226c84378/users/88c4f4ce799b4bdcafd935f927f0519b/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:33.835117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.835117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.835117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.876441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] MFA Rules not processed for user `88c4f4ce799b4bdcafd935f927f0519b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.877807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.962004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1168/2344] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:33.973773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.041225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6837fa-f7b4-43a2-9312-b95e3bc89d47 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.044999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.045572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.045856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.046127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.054807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.056242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0c961-2729-4491-8ff2-e60d3ed3a020 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.065043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1177/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:37.644791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:37.646289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:37.718306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d581462-1a06-4036-aae5-a1ea11cc8630 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:37.728906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:37.729797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:37.730224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:37.730751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] PATH_INFO: `/v3/users/571bdb03b67f432d8119cc1c75d8c85c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:37.732554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571bdb03b67f432d8119cc1c75d8c85c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:37.735075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:37.783685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571bdb03b67f432d8119cc1c75d8c85c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:37.791297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571bdb03b67f432d8119cc1c75d8c85c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:37.791990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571bdb03b67f432d8119cc1c75d8c85c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:37.792592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571bdb03b67f432d8119cc1c75d8c85c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:37.796286 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:37.802096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571bdb03b67f432d8119cc1c75d8c85c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:37.825726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1169/2346] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:37 2022] DELETE /identity/v3/users/571bdb03b67f432d8119cc1c75d8c85c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:37.830366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:37.831162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:37.831162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:37.852510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:37.854014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:37.922271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1178/2347] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:37.931808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:37.933197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:38.002154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e02d-511c-457b-ae86-6b884b684158 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:38.006113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:38.006824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:38.007236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:38.008443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:38.018629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:38.020188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:38.031818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1170/2348] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:38.322631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:38.324168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:38.342769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950953d9-ae9c-4a7b-b0de-d32d14399f25 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:38.358107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:38.358760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:38.359061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:38.359338 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] PATH_INFO: `/v3/projects/878b2adb68fa4b00856fdb4cef7dc641` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:38.360562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878b2adb68fa4b00856fdb4cef7dc641)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:38.362543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:38.364556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:38.422168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878b2adb68fa4b00856fdb4cef7dc641', 'request_id': 'req-7e4982fc-6547-4d68-a33b-f5e51431cbd7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.429257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878b2adb68fa4b00856fdb4cef7dc641', 'request_id': 'req-7e4982fc-6547-4d68-a33b-f5e51431cbd7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.436375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878b2adb68fa4b00856fdb4cef7dc641', 'request_id': 'req-7e4982fc-6547-4d68-a33b-f5e51431cbd7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.455645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] The token cache is being invalidate because project 878b2adb68fa4b00856fdb4cef7dc641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:38.456125 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.456657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.458429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1179/2349] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:38 2022] DELETE /identity/v3/projects/878b2adb68fa4b00856fdb4cef7dc641 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:38.463279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:38.479065 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a870-399e-4ad6-aa2e-b0fc799dc308 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:38.646419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:38.648520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:38.648809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:38.649244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] PATH_INFO: `/v3/users/895187f022b4491294061658d58cc455` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:38.651071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895187f022b4491294061658d58cc455)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:38.653382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:38.723157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895187f022b4491294061658d58cc455'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.731659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895187f022b4491294061658d58cc455'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.732686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895187f022b4491294061658d58cc455'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.733283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895187f022b4491294061658d58cc455'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.742196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895187f022b4491294061658d58cc455'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:38.760315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:38.766420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1171/2350] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:38 2022] DELETE /identity/v3/users/895187f022b4491294061658d58cc455 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:39.114304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.117742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.147641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4982fc-6547-4d68-a33b-f5e51431cbd7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.197926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.197926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.249186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.250883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.251343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.252540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] PATH_INFO: `/v3/users/88c4f4ce799b4bdcafd935f927f0519b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.254257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c4f4ce799b4bdcafd935f927f0519b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.257333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.303441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd43e-4204-4584-9b23-c2d86aa953b3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.308579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.309244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.309596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.310431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] PATH_INFO: `/v3/projects/6f0bc6b1e51a4ed29eda3937900030fa` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.311577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0bc6b1e51a4ed29eda3937900030fa)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.313524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.316543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c4f4ce799b4bdcafd935f927f0519b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.327880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c4f4ce799b4bdcafd935f927f0519b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.328679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c4f4ce799b4bdcafd935f927f0519b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.367953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c4f4ce799b4bdcafd935f927f0519b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.384830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0df0b99c-ce98-4371-af2f-85f56ac09191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c4f4ce799b4bdcafd935f927f0519b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.391794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1180/2351] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:39 2022] DELETE /identity/v3/users/88c4f4ce799b4bdcafd935f927f0519b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:39.395775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.396162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.396563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.399882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0bc6b1e51a4ed29eda3937900030fa', 'request_id': 'req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.408402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0bc6b1e51a4ed29eda3937900030fa', 'request_id': 'req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.419544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0bc6b1e51a4ed29eda3937900030fa', 'request_id': 'req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.419741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:39.420991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.425818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:39.434989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] The token cache is being invalidate because project 6f0bc6b1e51a4ed29eda3937900030fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:39.435301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.436125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.437776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1172/2352] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:39 2022] DELETE /identity/v3/projects/6f0bc6b1e51a4ed29eda3937900030fa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:39.442103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.446579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.496827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1181/2353] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:39.507063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.509472 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.528942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b766bde-d0f4-41d9-9bcd-b0ec3725de1f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.534064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.534751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.535062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.535337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] PATH_INFO: `/v3/users/b80a4afe35a24a8eacec047643cf547d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.536589 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80a4afe35a24a8eacec047643cf547d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.540101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.589173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:39.590357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde39a-71b7-42a8-9d7a-2aeaa1532346 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.598171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.598936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.599340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.599755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.605283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80a4afe35a24a8eacec047643cf547d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.612351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.613108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80a4afe35a24a8eacec047643cf547d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.613997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80a4afe35a24a8eacec047643cf547d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.614115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.614737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80a4afe35a24a8eacec047643cf547d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.624472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80a4afe35a24a8eacec047643cf547d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:39.625248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1182/2354] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:39.653612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1173/2355] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:39 2022] DELETE /identity/v3/users/b80a4afe35a24a8eacec047643cf547d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:40.219440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:40.235438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beab94a-00d3-423e-b2b0-e9e05b8ac790 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:40.243067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:40.245013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:40.358491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:40.359318 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:40.359702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:40.360081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] PATH_INFO: `/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:40.361615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e11cdf30af4575b2514ba7e6d47ba2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:40.364419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:40.368514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5de394-b82a-4777-8922-dc7349aaae4b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:40.374778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:40.375600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:40.375889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:40.376165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] PATH_INFO: `/v3/projects/63de4bbc978049b08090fc6226c84378` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:40.378740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63de4bbc978049b08090fc6226c84378)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:40.382236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:40.437335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e11cdf30af4575b2514ba7e6d47ba2', 'request_id': 'req-fef0c848-5219-44db-87f3-438f708199c0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.449182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:40.458470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e11cdf30af4575b2514ba7e6d47ba2', 'request_id': 'req-fef0c848-5219-44db-87f3-438f708199c0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.458624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63de4bbc978049b08090fc6226c84378', 'request_id': 'req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.467566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e11cdf30af4575b2514ba7e6d47ba2', 'request_id': 'req-fef0c848-5219-44db-87f3-438f708199c0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.468866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63de4bbc978049b08090fc6226c84378', 'request_id': 'req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.477662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63de4bbc978049b08090fc6226c84378', 'request_id': 'req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.488675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] The token cache is being invalidate because project a5e11cdf30af4575b2514ba7e6d47ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:40.488977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.490055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fef0c848-5219-44db-87f3-438f708199c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.492531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1183/2356] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:40 2022] DELETE /identity/v3/projects/a5e11cdf30af4575b2514ba7e6d47ba2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:40.498437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] The token cache is being invalidate because project 63de4bbc978049b08090fc6226c84378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:40.498854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.499635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8afc9d19-891c-4d6f-ac19-be5d1e3675b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:40.501600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1174/2357] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:40 2022] DELETE /identity/v3/projects/63de4bbc978049b08090fc6226c84378 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:42.076403 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:42.076852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:42.077697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:42.103506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] MFA Rules not processed for user `5f6cc15289c7415a91150f0d8025a77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:42.105152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:42.174681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1184/2358] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:45.639399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef6e2-c689-48a9-ae8c-2f7d33ac4b58 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.639868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef6e2-c689-48a9-ae8c-2f7d33ac4b58 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.639981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeef6e2-c689-48a9-ae8c-2f7d33ac4b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.659408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-caeef6e2-c689-48a9-ae8c-2f7d33ac4b58 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:45.660607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-caeef6e2-c689-48a9-ae8c-2f7d33ac4b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.696299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:45.721571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1175/2359] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:45.768162 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.770090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.859081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f8193-21bd-4ed8-8a47-c8574b13c5f5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.872512 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.873555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.873944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.874229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.876514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65325-f2c6-489a-a32c-61a668c6af04 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.876799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65325-f2c6-489a-a32c-61a668c6af04 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.877232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65325-f2c6-489a-a32c-61a668c6af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.893432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.895417 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.906148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1185/2360] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:45.915070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aaa65325-f2c6-489a-a32c-61a668c6af04 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:45.916774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aaa65325-f2c6-489a-a32c-61a668c6af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.925189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1176/2361] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:45.953054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.971097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249a1e-1dbb-45e5-a77b-69ba54e23caf service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.976847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.977534 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.977896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.978181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.989124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.990899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:46.001623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1186/2362] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:13:46.863846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b297c-9adb-44fa-97ee-35d91d12688b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:46.864365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b297c-9adb-44fa-97ee-35d91d12688b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:46.864600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b297c-9adb-44fa-97ee-35d91d12688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:46.904724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a08b297c-9adb-44fa-97ee-35d91d12688b None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:46.906829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a08b297c-9adb-44fa-97ee-35d91d12688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:46.918527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1177/2363] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:13:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:46.949431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:46.973068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e98330-ce07-4361-81b6-604e99cde2bc service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:46.987802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:46.988753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:46.989308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:46.989907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:47.003425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:47.007465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:47.034159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1187/2364] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:47.676000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ec44-4851-4ab8-9f6e-f88f7dd602e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:47.677083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ec44-4851-4ab8-9f6e-f88f7dd602e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:47.677574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ec44-4851-4ab8-9f6e-f88f7dd602e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:47.705944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3f42ec44-4851-4ab8-9f6e-f88f7dd602e3 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:47.707502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f42ec44-4851-4ab8-9f6e-f88f7dd602e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:47.744833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1178/2365] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:47.763067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:47.777203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c9fb-f234-4cbd-914e-1e3a319e0ad6 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:47.794626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:47.795539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:47.795909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:47.796413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:47.810608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:47.812936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:47.824655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1188/2366] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:13:48.436729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a665a-029e-44cd-bacc-34e52168807b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.437240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a665a-029e-44cd-bacc-34e52168807b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.437323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a665a-029e-44cd-bacc-34e52168807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.472622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-811a665a-029e-44cd-bacc-34e52168807b None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.474124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-811a665a-029e-44cd-bacc-34e52168807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.487564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1179/2367] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.516562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.544400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac595a6-18f0-447c-8bf1-facaac11e0be service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.591788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.592583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.593974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.597448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.624590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.626542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.648620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1189/2368] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:49.236900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2354e-469e-47c4-9b15-923aa71f121f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:49.238416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2354e-469e-47c4-9b15-923aa71f121f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:49.238416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2354e-469e-47c4-9b15-923aa71f121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:49.274123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-38c2354e-469e-47c4-9b15-923aa71f121f None None] MFA Rules not processed for user `67bb6da95fc446dcb4799b4f17bc882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:49.276617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-38c2354e-469e-47c4-9b15-923aa71f121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:49.383457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1180/2369] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:51.484847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:51.486362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:51.729237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:51.783272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242377fb-ec79-4b17-9569-c971cdc609f8 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:51.788812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:51.790254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:51.790707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:51.791155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] PATH_INFO: `/v3/users/3e88df413e7c40d5914a7b6f864a55a0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:51.792493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e88df413e7c40d5914a7b6f864a55a0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:51.794836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:51.869216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e88df413e7c40d5914a7b6f864a55a0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:51.877393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e88df413e7c40d5914a7b6f864a55a0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:51.878409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e88df413e7c40d5914a7b6f864a55a0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:51.889175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e88df413e7c40d5914a7b6f864a55a0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:51.903466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e88df413e7c40d5914a7b6f864a55a0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:51.911519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1190/2370] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:51 2022] DELETE /identity/v3/users/3e88df413e7c40d5914a7b6f864a55a0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:51.916323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:51.917226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:51.917534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:51.938914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:51.940514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:52.013917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1181/2371] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:52.028513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:52.030583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:52.148898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c485f9-5f43-43e0-875d-c6249a4da2ef admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:52.158394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:52.159627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:52.159627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:52.159844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:52.170813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:52.172392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9fc5-426c-4b20-9f20-3ff99121cbc6 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:52.187928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1191/2372] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:52.541245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:52.542775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:52.555518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0c61-3c2c-4398-b349-06d9414f495a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:52.561189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:52.561863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:52.562347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:52.562791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] PATH_INFO: `/v3/projects/1c0d0749d2884d85ac065d8efd9b7522` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:52.564121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0d0749d2884d85ac065d8efd9b7522)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:52.566518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:52.650295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0d0749d2884d85ac065d8efd9b7522', 'request_id': 'req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:52.659582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0d0749d2884d85ac065d8efd9b7522', 'request_id': 'req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:52.661698 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:52.675500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0d0749d2884d85ac065d8efd9b7522', 'request_id': 'req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:52.699693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] The token cache is being invalidate because project 1c0d0749d2884d85ac065d8efd9b7522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:52.700163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:52.701366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bca0c2d-f5f3-4127-86a2-297e3f8bcc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:52.706494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1182/2373] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:52 2022] DELETE /identity/v3/projects/1c0d0749d2884d85ac065d8efd9b7522 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:52.708877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:52.709428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:52.710245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:52.755313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:52.758871 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:52.883009 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:52.944900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1192/2374] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:52.952657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:52.953180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:52.953291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:52.984588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:52.986207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:52.999145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1183/2375] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:53.003617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.021325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ba7b-e45e-45de-adc5-5a99432218c1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.033181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.035026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.035294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.035587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.037124 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:53.039231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.043547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.064541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1193/2376] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:53.069081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.087380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784884c4-08c0-4b57-9758-3ed1e7a80fe1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.107002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.107808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.108153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.108468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.109153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.128168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.200062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1184/2377] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:53.201694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.218348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa121ab-e368-49c9-8fe8-98224dcc2e23 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.326116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.327763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.328046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.329411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.330282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.333100 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.369583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1194/2378] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:53 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:53.371369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.386591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e766-79ab-429e-aa1a-fdfe63c94e00 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.393977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.394852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.414725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.415308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.417451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.420132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.435124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1185/2379] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:53.440184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.464770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc291d-c3d1-4d4c-a1af-a1a5d72177b4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.490487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.491984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.492569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.493058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.494245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.496001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14379-198e-4af9-9981-6a7a1d812b6d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.519375 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1195/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:53.524066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.540498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc51274-a2f0-446d-be61-fc60d731ae53 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.548203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.549188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.549715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.549856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] PATH_INFO: `/v3/projects/68ad26196bae4310a62d99042f6e212c/users/15362176937b4337a7cac49095073e02/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.579714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ad26196bae4310a62d99042f6e212c, user_id=15362176937b4337a7cac49095073e02, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:53.586703 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:53.628208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1186/2381] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:53 2022] PUT /identity/v3/projects/68ad26196bae4310a62d99042f6e212c/users/15362176937b4337a7cac49095073e02/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:53.634439 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191d2e-278a-4e24-9e93-e79a7506496f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.634860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191d2e-278a-4e24-9e93-e79a7506496f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.635236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191d2e-278a-4e24-9e93-e79a7506496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:53.662000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-15191d2e-278a-4e24-9e93-e79a7506496f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:53.663930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-15191d2e-278a-4e24-9e93-e79a7506496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:53.800348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1196/2382] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:53.816371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:53.819757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:53.974935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175380f-5dcc-4943-adef-850898fbc7aa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:53.985548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:53.986465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:53.986898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:53.987307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:54.018131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:54.019881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:54.033459 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1187/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:55.449645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ff4e-0148-4e58-9536-c05fa4ebe975 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:55.450193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ff4e-0148-4e58-9536-c05fa4ebe975 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:55.450193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ff4e-0148-4e58-9536-c05fa4ebe975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:55.517787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7642ff4e-0148-4e58-9536-c05fa4ebe975 None None] MFA Rules not processed for user `15362176937b4337a7cac49095073e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:55.519033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7642ff4e-0148-4e58-9536-c05fa4ebe975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:55.638212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:55.690675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1197/2384] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:55.702630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:55.706907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:55.852515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566fa0c-8525-4973-acc2-f2880d1ee344 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:55.862880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:55.864195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:55.864651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:55.865092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:55.909247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:55.910747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3951f2-64be-4b71-ad2a-5d47d9412846 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:55.927374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1188/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:57.503142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:57.505740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:57.505740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:57.523976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] MFA Rules not processed for user `15362176937b4337a7cac49095073e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:57.525370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:57.532563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1198/2386] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:03.861791 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05385679-9672-4b28-847b-02ba68b742e8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:03.862394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05385679-9672-4b28-847b-02ba68b742e8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:03.862394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05385679-9672-4b28-847b-02ba68b742e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:03.884221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-05385679-9672-4b28-847b-02ba68b742e8 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:03.885624 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-05385679-9672-4b28-847b-02ba68b742e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:03.913747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:03.949440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1189/2387] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:03.963671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:03.965127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:04.043390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7aef9f-749f-44dc-9f75-dcd16d33ea5e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:04.048927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:04.049575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:04.049918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:04.050258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:04.060918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:04.062682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187489-af65-409e-a5df-4df49f91e5fd service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:04.072537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1199/2388] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:07.075133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.075599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.075751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.077167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1190/2389] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:14:07.089471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0470-bbbc-459b-9abc-4621625402fb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.090460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0470-bbbc-459b-9abc-4621625402fb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.090891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0470-bbbc-459b-9abc-4621625402fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.136138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5d3e0470-bbbc-459b-9abc-4621625402fb None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:07.137673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5d3e0470-bbbc-459b-9abc-4621625402fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:07.324952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1200/2390] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:14:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:07.336857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:07.339343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:07.423524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11995871-6b14-4b07-a660-3bafd3052073 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:07.442512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:07.442512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.442512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.442512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.458937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:07.460714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6fe4d-5e63-4475-80e8-d7a7aa3c1750 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:07.490808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1191/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:07.574950 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d6a-b60a-4164-9ad3-e34c6503928f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.575266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d6a-b60a-4164-9ad3-e34c6503928f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.575543 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d6a-b60a-4164-9ad3-e34c6503928f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.577027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1201/2392] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:14:07.582600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945c374-a88b-4182-b4ee-d60ed9f3ae89 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.582890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945c374-a88b-4182-b4ee-d60ed9f3ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.583169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945c374-a88b-4182-b4ee-d60ed9f3ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.649384 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6945c374-a88b-4182-b4ee-d60ed9f3ae89 None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:07.650711 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6945c374-a88b-4182-b4ee-d60ed9f3ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:07.658662 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1192/2393] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:14:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:07.672485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958d6a-b60a-4164-9ad3-e34c6503928f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:07.684978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958d6a-b60a-4164-9ad3-e34c6503928f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:07.691896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:07.692576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.692925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.693330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.704598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:07.706518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136113f-f8c7-4fec-9ee0-ae5bd61bbe7d service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:07.716482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1202/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:14:07.829246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270395a-5b92-4fb9-9220-4320633fa8ca None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.829610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270395a-5b92-4fb9-9220-4320633fa8ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.829901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270395a-5b92-4fb9-9220-4320633fa8ca None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.831868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1193/2395] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:14:07.840582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4468531-20a8-4dfe-b590-fdbcd51b7507 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.840891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4468531-20a8-4dfe-b590-fdbcd51b7507 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.841143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4468531-20a8-4dfe-b590-fdbcd51b7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.881440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e4468531-20a8-4dfe-b590-fdbcd51b7507 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:07.882980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e4468531-20a8-4dfe-b590-fdbcd51b7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:07.895552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1203/2396] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:14:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:07.913152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270395a-5b92-4fb9-9220-4320633fa8ca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:07.931821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270395a-5b92-4fb9-9220-4320633fa8ca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:07.939292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:07.940225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:07.940590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:07.941013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:07.955730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:07.957173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:07.975647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1194/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:12.027733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad57-0cab-4211-8a80-740a553c8966 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:12.028311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad57-0cab-4211-8a80-740a553c8966 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:12.028311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad57-0cab-4211-8a80-740a553c8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:12.049347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ebd3ad57-0cab-4211-8a80-740a553c8966 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:12.050618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ebd3ad57-0cab-4211-8a80-740a553c8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:12.058751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1204/2398] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:12.075492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:12.089336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02418-5a16-43e5-a678-6d714d7d47db service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:12.094908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:12.095652 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:12.096028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:12.096397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:12.122265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:12.123972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:12.164352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1195/2399] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:22.043924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:22.152030 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=53 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:22.779295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:22.779583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:22.779861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:22.800664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:22.802639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:22.810023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1205/2400] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:14:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:22.822579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:22.833615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f09821-126a-492b-81c3-9ca96993f9bd service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:22.844184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:22.844822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:22.845109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:22.845381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:22.856167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:22.857825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:22.867322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1196/2401] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:14:24.808775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:24.810271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:24.825809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b922e-1f72-422a-994e-26cdb0993460 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:24.831491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:24.832206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:24.832498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:24.832772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] PATH_INFO: `/v3/users/5f6cc15289c7415a91150f0d8025a77d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:24.834335 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6cc15289c7415a91150f0d8025a77d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:24.836625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:24.883456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6cc15289c7415a91150f0d8025a77d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:24.890325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6cc15289c7415a91150f0d8025a77d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:24.890995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6cc15289c7415a91150f0d8025a77d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:24.898277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6cc15289c7415a91150f0d8025a77d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:24.910113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f55e1753-4730-4c67-b008-80d34af6ca76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6cc15289c7415a91150f0d8025a77d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:24.916260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1206/2402] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:14:24 2022] DELETE /identity/v3/users/5f6cc15289c7415a91150f0d8025a77d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:25.099581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.123280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64ba3-83e9-4f99-82ee-06ae35f4f13e service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.190311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.191140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.191429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.191705 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] PATH_INFO: `/v3/projects/954801aed5bf4f46b1b171c3e2cf4a02` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.193042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954801aed5bf4f46b1b171c3e2cf4a02)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.194993 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.265004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954801aed5bf4f46b1b171c3e2cf4a02', 'request_id': 'req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.271870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954801aed5bf4f46b1b171c3e2cf4a02', 'request_id': 'req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.280259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954801aed5bf4f46b1b171c3e2cf4a02', 'request_id': 'req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.298754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] The token cache is being invalidate because project 954801aed5bf4f46b1b171c3e2cf4a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:14:25.299054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.299728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd4e3f40-bda7-4efa-b5aa-ed5b76773801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.305264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1197/2403] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:14:25 2022] DELETE /identity/v3/projects/954801aed5bf4f46b1b171c3e2cf4a02 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:25.306944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.307262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.307539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.326882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:25.328116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.387426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1207/2404] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:25.395937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.396225 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.396540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.417952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:25.419171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.427223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1198/2405] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:25.431434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.440946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6de28a-3657-4a97-b697-6135134e19ab None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.445912 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.446498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.446774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.447042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.447672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:14:25.447972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.449584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.461855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1208/2406] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:14:25.466332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.476509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd20cf-8eb8-404e-88f2-7ce968ae7525 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.481275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.481919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.482195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.482465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.483089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.485001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.514920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1199/2407] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:25.519291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.530331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7374d6-7d8d-46db-b556-db4e4d6bd62f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.584278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:25.595825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.596500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.596780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.597051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.597715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.599710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.633669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1209/2408] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:25.635669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.646930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58759372-9b20-47f6-a570-d9ee76599a34 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.651684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.652296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.652574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.652848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.653495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.655128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.669085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1200/2409] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:14:25.670300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.687790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4266d-2fde-43b6-abd6-4826845e5760 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.693793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.694434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.694713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.695240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.695629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.697279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24430-cf6d-459f-a3fc-11c911714d57 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.708888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1210/2410] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:14:25.713315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.724513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75ed3e-6fd2-40ed-a7b1-4ab45b96fa62 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.729419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.730120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.730400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.730676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] PATH_INFO: `/v3/projects/d734e16d608948b1b3939984b5bd54e6/users/d628200e10e3429c82177d7307d94eb4/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.746599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d734e16d608948b1b3939984b5bd54e6, user_id=d628200e10e3429c82177d7307d94eb4, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.749278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.762371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1201/2411] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:14:25 2022] PUT /identity/v3/projects/d734e16d608948b1b3939984b5bd54e6/users/d628200e10e3429c82177d7307d94eb4/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:14:25.767288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e4d7-ef35-4343-93e8-b903726476a9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.767571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e4d7-ef35-4343-93e8-b903726476a9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.767840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e4d7-ef35-4343-93e8-b903726476a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.786891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f1c8e4d7-ef35-4343-93e8-b903726476a9 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:25.788089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f1c8e4d7-ef35-4343-93e8-b903726476a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.847897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1211/2412] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:25.858155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.860179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.875304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:25.920724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412765e6-d6aa-42da-a818-a28a9a27c00e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.924436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.925053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.925354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.925635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.935195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.936682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.947232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1202/2413] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:29.815561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a71c-f7ee-41b6-8ebc-e491a4445b4e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:29.815561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a71c-f7ee-41b6-8ebc-e491a4445b4e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:29.815561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a71c-f7ee-41b6-8ebc-e491a4445b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:29.852082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6997a71c-f7ee-41b6-8ebc-e491a4445b4e None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:29.853305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6997a71c-f7ee-41b6-8ebc-e491a4445b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:29.967905 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1212/2414] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:29.987169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:29.989732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:30.126198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64319-35d7-41dc-ac72-187a319c60f8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:30.132064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:30.132911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:30.133527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:30.134084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:30.144261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:30.146445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:30.161305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1203/2415] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:31.007393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.010459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.011276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.053656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] MFA Rules not processed for user `d628200e10e3429c82177d7307d94eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:31.054877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:31.139376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1213/2416] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:31.144136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.160437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd62-6436-4d7a-85e3-040ac6917562 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.167579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.168217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.168508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.168997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.169762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.171971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.209991 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1204/2417] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:14:31 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:31.214090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.226159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d99a3d-0f02-4a22-ac39-8cbaef76506a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.230249 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:31.294149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.294778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.295064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.295366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.296023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.298023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.320661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1214/2418] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:14:31 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:31.324730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.337432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ce954-884a-4b89-8fad-0b5336d2060b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.343319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.343917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.344202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.344510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.345156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.346825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.359508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1205/2419] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:14:31.364114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.375661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d7b7-5fee-4687-9746-bcf71bfc7b1e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.381210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.382203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.382411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.382696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] PATH_INFO: `/v3/projects/ac5d192b40ed42a4accd640e6e199294/users/a07b54ebc7b147b89b84087381209e80/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.403164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5d192b40ed42a4accd640e6e199294, user_id=a07b54ebc7b147b89b84087381209e80, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.406159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.425594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1215/2420] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:14:31 2022] PUT /identity/v3/projects/ac5d192b40ed42a4accd640e6e199294/users/a07b54ebc7b147b89b84087381209e80/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:31.427721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.439245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a329eb-1a51-425e-a5e7-6dd63df6bf34 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.534529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.535117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.535397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.536373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.537152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.538846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c724b9-d1fb-4e3c-add2-f10d5a3b9df6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.550188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1206/2421] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:14:31.554787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:31.569326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858973b-972a-4dd4-acce-69a3f2ea7283 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:31.585893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:31.586712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:31.587097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:31.587836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] PATH_INFO: `/v3/projects/ac5d192b40ed42a4accd640e6e199294/users/a07b54ebc7b147b89b84087381209e80/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:31.591698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5d192b40ed42a4accd640e6e199294, user_id=a07b54ebc7b147b89b84087381209e80, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:31.595662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158218-5475-4653-a631-e2dd823fbafd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:31.622842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1216/2422] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:14:31 2022] PUT /identity/v3/projects/ac5d192b40ed42a4accd640e6e199294/users/a07b54ebc7b147b89b84087381209e80/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:33.389754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:33.390706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:33.392086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:33.420858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] MFA Rules not processed for user `049df06cc2454185b611ff75538f7877`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:33.423326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:33.429707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:33.533099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1207/2423] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:37.867973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e75d-5abb-4f32-a50b-05ea65cd995d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:37.868399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e75d-5abb-4f32-a50b-05ea65cd995d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:37.868623 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e75d-5abb-4f32-a50b-05ea65cd995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:37.901973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0019e75d-5abb-4f32-a50b-05ea65cd995d None None] MFA Rules not processed for user `a07b54ebc7b147b89b84087381209e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:37.903602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0019e75d-5abb-4f32-a50b-05ea65cd995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:38.051954 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1217/2424] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:38.073419 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:38.075614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:38.178741 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef89bd-3833-442a-b293-a7ccd07c3062 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:38.187334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:38.187975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.188257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.188534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.322620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:38.324420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:38.335710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1208/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:38.545211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adebd23-deee-4f4a-b7f3-9c815e8e4bd7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.545424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adebd23-deee-4f4a-b7f3-9c815e8e4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.545785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adebd23-deee-4f4a-b7f3-9c815e8e4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.570060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6adebd23-deee-4f4a-b7f3-9c815e8e4bd7 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:38.571311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6adebd23-deee-4f4a-b7f3-9c815e8e4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:38.636760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:38.661673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1218/2426] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:38.679135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:38.772923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb308e-c92e-43a6-bbd9-21d7ee36bb08 service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:38.778304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:38.778926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.779207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.779478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.788352 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:38.790457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:38.793944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:38.799794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1209/2427] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:39.994719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c0f9-58f2-4dda-a762-10bfbf6ccb55 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:39.998845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c0f9-58f2-4dda-a762-10bfbf6ccb55 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:39.999223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c0f9-58f2-4dda-a762-10bfbf6ccb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:40.078592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9b92c0f9-58f2-4dda-a762-10bfbf6ccb55 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:40.080936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9b92c0f9-58f2-4dda-a762-10bfbf6ccb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:40.226945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1219/2428] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:40.242252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:40.244422 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:40.378220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0d8d2-7674-4689-99e7-0c82642f18c1 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:40.387636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:40.390358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:40.390649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:40.390916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:40.401368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:40.403617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:40.415307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1210/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:14:44.104305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d866e-6a2e-4f63-8555-05a88252f846 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:44.104877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d866e-6a2e-4f63-8555-05a88252f846 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:44.107578 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d866e-6a2e-4f63-8555-05a88252f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:44.137785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e09d866e-6a2e-4f63-8555-05a88252f846 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:44.139091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e09d866e-6a2e-4f63-8555-05a88252f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:44.151484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1220/2430] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:44.169945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:44.184063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f59594-c5b7-4a77-80dc-c058f57fe9f4 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:44.190398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:44.191134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:44.191460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:44.191746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:44.201892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:44.203539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:44.214818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1211/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:47.492184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b566bf-60ce-4f82-9edd-13ffd5525e6a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:47.493274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b566bf-60ce-4f82-9edd-13ffd5525e6a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:47.493749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b566bf-60ce-4f82-9edd-13ffd5525e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:47.524942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e0b566bf-60ce-4f82-9edd-13ffd5525e6a None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:47.527222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e0b566bf-60ce-4f82-9edd-13ffd5525e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:47.538721 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1221/2432] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:47.556566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:47.558349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:47.575559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3a18d-e976-4aa5-b9b4-4c09ff55bdde service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:47.581776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:47.582510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:47.582794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:47.583069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:47.598527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:47.600254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:47.615626 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1212/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:48.825219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893add9-d2d8-4e2a-ac33-64e24ada61cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:48.825797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893add9-d2d8-4e2a-ac33-64e24ada61cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:48.825797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893add9-d2d8-4e2a-ac33-64e24ada61cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:48.854540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1893add9-d2d8-4e2a-ac33-64e24ada61cc None None] MFA Rules not processed for user `d628200e10e3429c82177d7307d94eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:48.855968 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1893add9-d2d8-4e2a-ac33-64e24ada61cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:48.865628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1222/2434] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:14:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:50.288302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:50.289792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:50.371159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7336d0-3c1d-4ef6-9ad9-778c771ad617 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:50.377297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:50.378327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:50.379344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:50.379825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:50.382827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:50.400012 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:50.400350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:50.412536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1213/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:50.607077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ce88-77ad-4f68-8f30-80865d151e21 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:50.608047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ce88-77ad-4f68-8f30-80865d151e21 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:50.609127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6ce88-77ad-4f68-8f30-80865d151e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:50.643382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b1b6ce88-77ad-4f68-8f30-80865d151e21 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:50.646705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b1b6ce88-77ad-4f68-8f30-80865d151e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:50.668741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1223/2436] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:50.689054 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:50.708786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df4b9-4380-463d-ae76-d33d14a77b8b service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:50.715205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:50.716302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:50.717564 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:50.718203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:50.730692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:50.732891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:50.745472 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1214/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:53.764423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd3b4-45d6-4099-be33-e060fa80a63d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:53.764919 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd3b4-45d6-4099-be33-e060fa80a63d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:53.765025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd3b4-45d6-4099-be33-e060fa80a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:53.784506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a3ecd3b4-45d6-4099-be33-e060fa80a63d None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:53.786304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a3ecd3b4-45d6-4099-be33-e060fa80a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:53.794581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1224/2438] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:53.812541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:53.823802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172703-5c34-46ff-8059-d727fcea856f service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:53.829619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:53.830399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:53.830603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:53.830913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:53.840363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:53.841996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:53.851982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1215/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:56.029434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be2e0-e762-4bcc-9b52-f125eccd2915 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:56.029978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be2e0-e762-4bcc-9b52-f125eccd2915 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:56.030089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be2e0-e762-4bcc-9b52-f125eccd2915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:56.049736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5b7be2e0-e762-4bcc-9b52-f125eccd2915 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:56.050989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5b7be2e0-e762-4bcc-9b52-f125eccd2915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:56.058167 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1225/2440] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:56.070841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:56.082999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2605c-6686-49b9-86fc-eb33764c998d service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:56.089534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:56.090198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:56.090482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:56.090759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:56.100303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:56.101946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:56.110820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1216/2441] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:58.019917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd79a9-d276-4500-8e8b-012b0298a3ea None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:58.020662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd79a9-d276-4500-8e8b-012b0298a3ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:58.020662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd79a9-d276-4500-8e8b-012b0298a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:58.047197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-55dd79a9-d276-4500-8e8b-012b0298a3ea None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:58.048563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-55dd79a9-d276-4500-8e8b-012b0298a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:58.058626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1226/2442] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:58.077493 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:58.107090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f006e-9954-48d2-84fe-0a51cf70dc52 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:58.114414 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:58.115323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:58.115780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:58.116057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:58.129863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:58.134140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:58.135945 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:58.149350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1217/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:08.042768 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=53 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:08.143397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:24.256157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af08-8bc6-4f40-8a64-1390fa479219 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:24.256705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af08-8bc6-4f40-8a64-1390fa479219 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:24.256705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957af08-8bc6-4f40-8a64-1390fa479219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:24.275733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0957af08-8bc6-4f40-8a64-1390fa479219 None None] MFA Rules not processed for user `c68a9247d24247c5ab68e929625bac4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:24.276941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0957af08-8bc6-4f40-8a64-1390fa479219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:24.336419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1227/2444] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:15:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:24.718914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:24.781162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050915e-53b3-42e5-8ce0-50db2ab626b2 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:24.785677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:24.786418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:24.786704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:24.786979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:24.796732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:24.798200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b922-e7b6-4147-8354-5fbadea1daeb service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:24.808918 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1218/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:15:25.145687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400668-a28d-4177-b659-442892f48459 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:25.145982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400668-a28d-4177-b659-442892f48459 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:25.146257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400668-a28d-4177-b659-442892f48459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:25.167431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-07400668-a28d-4177-b659-442892f48459 None None] MFA Rules not processed for user `15362176937b4337a7cac49095073e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:25.168641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-07400668-a28d-4177-b659-442892f48459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:25.241333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1228/2446] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:15:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:27.545280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:27.545952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:27.547880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:27.578433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] MFA Rules not processed for user `67bb6da95fc446dcb4799b4f17bc882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:27.579970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:27.683326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1219/2447] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:15:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:35.232859 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=50 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:37.656979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=51 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:46.119591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b71a16-6d9b-479a-a5c9-488b140e8366 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:46.120115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b71a16-6d9b-479a-a5c9-488b140e8366 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:46.120309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b71a16-6d9b-479a-a5c9-488b140e8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:46.140599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-78b71a16-6d9b-479a-a5c9-488b140e8366 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:46.142485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-78b71a16-6d9b-479a-a5c9-488b140e8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:46.150937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1229/2448] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:15:46.188954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:46.203288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24400d3b-01db-4c14-8141-80b5868b0881 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:46.209874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:46.210811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:46.211300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:46.211644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:46.222199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:46.223812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:46.234277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1220/2449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:49.412130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412e32-a15c-40cd-a021-63fa91069ab8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:49.412642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412e32-a15c-40cd-a021-63fa91069ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:49.412729 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412e32-a15c-40cd-a021-63fa91069ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:49.432697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5a412e32-a15c-40cd-a021-63fa91069ab8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:49.433944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5a412e32-a15c-40cd-a021-63fa91069ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:49.443920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1230/2450] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:49.458798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:49.472034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966c3fd-6178-42a4-9bf6-402eb8bdb54f service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:49.477870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:49.478491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:49.478782 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:49.479051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:49.488694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:49.490620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a5eb-d6d1-4081-92e3-7374fa6acfc0 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:49.502694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1221/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:15:50.680117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:50.680596 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:50.680691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:50.700172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] MFA Rules not processed for user `049df06cc2454185b611ff75538f7877`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:50.701355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:50.708331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1231/2452] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:15:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:52.497775 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571b3b-285a-47d4-b327-09ba416a8c25 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:52.498291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571b3b-285a-47d4-b327-09ba416a8c25 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:52.498490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571b3b-285a-47d4-b327-09ba416a8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:52.519170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f4571b3b-285a-47d4-b327-09ba416a8c25 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:52.520394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f4571b3b-285a-47d4-b327-09ba416a8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:52.528603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1222/2453] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:52.548182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:52.560835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb9f4-9a0b-44df-909d-3ef7af8d711f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:52.566983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:52.567579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:52.567863 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:52.568138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:52.576163 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:52.577769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:52.587927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1232/2454] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:55.660298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497502-1048-4ae6-a8c5-565103919ee0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:55.660853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497502-1048-4ae6-a8c5-565103919ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:55.661059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a497502-1048-4ae6-a8c5-565103919ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:55.680873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a497502-1048-4ae6-a8c5-565103919ee0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:55.682102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a497502-1048-4ae6-a8c5-565103919ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:55.690883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1223/2455] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:55.706544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:55.717559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae07b0-6d83-4a25-92e4-9876617d40aa service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:55.723539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:55.724205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:55.724560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:55.724834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:55.733407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:55.735104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:55.744636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1233/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:59.878221 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:59.878779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:59.878779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:59.898612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:59.899857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:59.908287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1224/2457] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:59.923381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:59.939680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376eb39-82be-4645-a7cc-604328151e2a service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:59.945862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:59.946471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:59.946755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:59.947030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:59.955769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:59.957388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:59.967461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1234/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:09.893567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=21 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:09.963048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=27 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:30.416674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:30.418177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:30.431270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef1d57-88f4-48f5-ac98-b78ba2660cad None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:30.436565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:30.437206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:30.437488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:30.437858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] PATH_INFO: `/v3/users/15362176937b4337a7cac49095073e02` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:30.439013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=15362176937b4337a7cac49095073e02)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:30.440951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:30.488800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15362176937b4337a7cac49095073e02'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.495747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15362176937b4337a7cac49095073e02'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.496415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15362176937b4337a7cac49095073e02'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.497015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15362176937b4337a7cac49095073e02'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.504876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15362176937b4337a7cac49095073e02'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.522875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1225/2459] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:16:30 2022] DELETE /identity/v3/users/15362176937b4337a7cac49095073e02 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:16:30.693174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:30.703724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3e60d-94ac-4806-976e-97c75732d435 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:30.760491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:30.761111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:30.761388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:30.761693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] PATH_INFO: `/v3/projects/68ad26196bae4310a62d99042f6e212c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:30.762783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ad26196bae4310a62d99042f6e212c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:30.764662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:30.810191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ad26196bae4310a62d99042f6e212c', 'request_id': 'req-b28e9573-fc51-4187-9638-c3355713245f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.816248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ad26196bae4310a62d99042f6e212c', 'request_id': 'req-b28e9573-fc51-4187-9638-c3355713245f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.822555 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ad26196bae4310a62d99042f6e212c', 'request_id': 'req-b28e9573-fc51-4187-9638-c3355713245f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.836510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] The token cache is being invalidate because project 68ad26196bae4310a62d99042f6e212c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:16:30.837013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.837898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:30.840075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1235/2460] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:16:30 2022] DELETE /identity/v3/projects/68ad26196bae4310a62d99042f6e212c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:16:37.767260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:37.769283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:37.784254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc1c7e-37b3-467d-8fe4-d330b6f2abaf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:37.843871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:37.844665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:37.845003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:37.845290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] PATH_INFO: `/v3/users/67bb6da95fc446dcb4799b4f17bc882a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:37.846570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb6da95fc446dcb4799b4f17bc882a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:37.848551 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:37.895893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb6da95fc446dcb4799b4f17bc882a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:37.902713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb6da95fc446dcb4799b4f17bc882a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:37.903371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb6da95fc446dcb4799b4f17bc882a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:37.903970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb6da95fc446dcb4799b4f17bc882a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:37.911845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9d2522a-73d1-49c7-acc1-61aba210d3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb6da95fc446dcb4799b4f17bc882a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:37.919640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:37.930736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1226/2461] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:16:37 2022] DELETE /identity/v3/users/67bb6da95fc446dcb4799b4f17bc882a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:16:38.101927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.104049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:38.117553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9573-fc51-4187-9638-c3355713245f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.181979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.182656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.183085 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.183366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] PATH_INFO: `/v3/projects/4e97fb6362894ecaa285678f0e42dfb8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.185135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e97fb6362894ecaa285678f0e42dfb8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.189035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.226154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:38.240741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e97fb6362894ecaa285678f0e42dfb8', 'request_id': 'req-33949557-fa73-4762-9f18-5ec93742827c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:38.246681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e97fb6362894ecaa285678f0e42dfb8', 'request_id': 'req-33949557-fa73-4762-9f18-5ec93742827c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:38.254058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e97fb6362894ecaa285678f0e42dfb8', 'request_id': 'req-33949557-fa73-4762-9f18-5ec93742827c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:38.268043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] The token cache is being invalidate because project 4e97fb6362894ecaa285678f0e42dfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:16:38.268475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:38.269173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-33949557-fa73-4762-9f18-5ec93742827c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:16:38.270957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1236/2462] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:16:38 2022] DELETE /identity/v3/projects/4e97fb6362894ecaa285678f0e42dfb8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:16:38.275940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.276233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.276513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.299266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:38.300502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:38.362465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1227/2463] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:38.370741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.371052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.371328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.394608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:38.395835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:38.403696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1237/2464] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:16:38.408135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.417995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea906-9689-4e88-b58d-f952884c0c36 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.422591 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.423189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.423470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.423745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.424391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:16:38.424697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.426418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.438571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1228/2465] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:16:38.443188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.453381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364be45d-b3a6-4a05-aea6-973e96a71caf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.458293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.458888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.459165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.459435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.460051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.462231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.492594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1238/2466] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:16:38.496962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.507633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aecee-005d-4522-b7ab-87515fd1756e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.565264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.565909 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.566191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.566465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.567107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.569013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.590907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1229/2467] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:16:38 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:16:38.595184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.605341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0736a8-0221-4a66-82b3-62a6352992b9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.613787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.614395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.614673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.614941 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.615580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.617147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.627644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1239/2468] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:16:38.631619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.642206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4beee-c706-4ca1-828a-af72195a2898 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.647048 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.647650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.647933 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.648207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.648850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.650471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9826-fe57-4c3c-b9d4-20b1daae6317 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.661149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1230/2469] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:16:38.665325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.676300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cfd7f-d442-43a4-b446-f662b90c8a43 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.681005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.681618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.681899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.682168 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] PATH_INFO: `/v3/projects/8c612ba3f54c4f4e8313dcef73afc483/users/9c68e1e3809a472eaf5db0e573a2578c/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.698594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c612ba3f54c4f4e8313dcef73afc483, user_id=9c68e1e3809a472eaf5db0e573a2578c, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.701280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.714503 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1240/2470] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:16:38 2022] PUT /identity/v3/projects/8c612ba3f54c4f4e8313dcef73afc483/users/9c68e1e3809a472eaf5db0e573a2578c/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:16:38.719925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c715c-9926-4c74-92f5-48d6a3dcc485 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.720183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c715c-9926-4c74-92f5-48d6a3dcc485 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.720455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c715c-9926-4c74-92f5-48d6a3dcc485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.739623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-384c715c-9926-4c74-92f5-48d6a3dcc485 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:38.740800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-384c715c-9926-4c74-92f5-48d6a3dcc485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:38.790710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:38.802394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1231/2471] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:38.813499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:38.815225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:38.872154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f464-6a6f-4f6f-b620-07afa36e147c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:38.876431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:38.877032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:38.877312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:38.877613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:38.886670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:38.888109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:38.897625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1241/2472] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:43.059550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679ba2-b9d3-44fb-bd9f-55349461a647 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:43.059984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679ba2-b9d3-44fb-bd9f-55349461a647 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:43.060137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679ba2-b9d3-44fb-bd9f-55349461a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:43.091267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-11679ba2-b9d3-44fb-bd9f-55349461a647 None None] MFA Rules not processed for user `9c68e1e3809a472eaf5db0e573a2578c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:43.093341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11679ba2-b9d3-44fb-bd9f-55349461a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:43.164471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1232/2473] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:16:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:43.178738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:43.180369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:43.240217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:43.263480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b086-4862-4487-95f5-eba6d00ef40b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:43.291080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:43.291720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:43.292000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:43.292270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:43.301169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:43.303276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:43.314844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1242/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:44.703996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:44.704535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:44.704647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:44.734655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] MFA Rules not processed for user `9c68e1e3809a472eaf5db0e573a2578c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:44.735113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:44.736369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:44.736523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:44.750997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1233/2475] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:16:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:44.753122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceda675-73f8-4784-9264-a57f3a864520 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:44.757071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:44.757367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:44.757675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:44.757944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:44.759660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:44.773435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:44.774924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:44.787674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1243/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:46.010960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:46.022399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c839289-bc2b-42d8-b0f1-5a966dca3950 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:46.028956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:46.030267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:46.030598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:46.030882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:46.032872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:46.047508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:46.048992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0d5e-cc8d-43ba-9bd9-5bb23d01f980 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:46.060986 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1234/2477] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:53.238416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:53.254269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b33fe-cc9c-4d9e-a5bf-3faf13e61071 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:53.259847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:53.260551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:53.260894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:53.261232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:53.263165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:53.325807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:53.327517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:53.337017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1244/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:56.056979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=42 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:57.516293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21145f6-ea94-4224-a27e-405ce04c23d7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:57.516949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21145f6-ea94-4224-a27e-405ce04c23d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:57.517303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21145f6-ea94-4224-a27e-405ce04c23d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:57.538455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f21145f6-ea94-4224-a27e-405ce04c23d7 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:57.539762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f21145f6-ea94-4224-a27e-405ce04c23d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:57.602050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1235/2479] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:57.651143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:57.652616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:57.744955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ce9-bcae-4935-8903-f330536cc565 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:57.751205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:57.752135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:57.752522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:57.752896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:57.763321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:57.766045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:57.794909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1245/2480] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:16:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:17:02.381365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:02.381884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:02.382020 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:02.406906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] MFA Rules not processed for user `049df06cc2454185b611ff75538f7877`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:02.408203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:02.485557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1236/2481] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:02.834339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:02.846374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79e8a-a010-4cc5-91e3-197441eca456 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:02.849934 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:02.850818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:02.851418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:02.851799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:02.853691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:02.867931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:02.868152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:02.887436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1246/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:03.252305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:03.253810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:03.358251 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac254d29-e5e1-47c6-8ebf-87d1cb2277c2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:03.365307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:03.366047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:03.366329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:03.366620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:03.368369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:03.382510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:03.385477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea3263-b541-4d57-9e10-f6ada2b70365 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:03.398409 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1237/2483] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:08.256084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:08.266245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7595-8bce-4c9d-87cb-8f9edad7b52e service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:08.272790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:08.274362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:08.274963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:08.275519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:08.278350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:08.312033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:08.314350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:08.325057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1247/2484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:13.392804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:18.021848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:18.022460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:18.022460 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:18.042480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:18.043766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:18.051003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1238/2485] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 29 02:17:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:18.064111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:18.070735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:18.078835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e274632-35bc-40f4-b28d-23da195e589c service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:18.083866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:18.084498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:18.084804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:18.085052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:18.094111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:18.095924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e72c9a-5616-420c-b997-0fba50cccb60 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:18.104876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1248/2486] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:17:18.550507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:18.570457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0fb0-ce2d-46d2-91b3-8994890101a7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:18.581444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:18.582256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:18.582865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:18.583400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:18.585980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:18.607347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:18.608954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:18.623679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1239/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:28.102042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:28.609650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:28.609970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:28.610248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:28.616750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=9 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:28.629754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:28.630978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:28.638021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1249/2488] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:28.650461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:28.662168 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f308-fa48-4a18-b773-c1cf8fea8609 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:28.667092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:28.667690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:28.667972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:28.668246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:28.676646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:28.678256 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bab0d-69e0-4db8-b50e-100b63e3c4d7 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:28.686159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1240/2489] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:17:32.042279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:32.045118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:32.084878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13873-0901-494c-9e95-f84b0b2c6313 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:32.105082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:32.106028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:32.106310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:32.106793 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:32.109487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:32.126054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:32.128275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:32.141962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1250/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:33.595138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.595668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.595668 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.615818 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] MFA Rules not processed for user `ba2b07df4c0a40ad851b598274877ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:33.617039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.624649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1241/2491] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:33.637486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.650297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8de29-ea50-4db7-b757-e496524e362e service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.656576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c9ac2314b84688b03c1e9f2924595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.657466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.657844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.658191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.667181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.671062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.680184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1251/2492] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 29 02:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:17:35.498362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:35.499805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:35.514946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d01d-09ea-454b-8642-f0cdcc709a08 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:35.519407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:35.520092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:35.520372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:35.520645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] PATH_INFO: `/v3/users/d628200e10e3429c82177d7307d94eb4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:35.521805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d628200e10e3429c82177d7307d94eb4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:35.523733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:35.569383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd628200e10e3429c82177d7307d94eb4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.576653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd628200e10e3429c82177d7307d94eb4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.577322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd628200e10e3429c82177d7307d94eb4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.577964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd628200e10e3429c82177d7307d94eb4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.585883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd628200e10e3429c82177d7307d94eb4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.603080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1242/2493] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:17:35 2022] DELETE /identity/v3/users/d628200e10e3429c82177d7307d94eb4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:17:35.778780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:35.790973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0884659-0daf-4d16-b498-eafefab08e42 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:35.848916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:35.849702 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:35.850047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:35.850352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] PATH_INFO: `/v3/projects/d734e16d608948b1b3939984b5bd54e6` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:35.851500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d734e16d608948b1b3939984b5bd54e6)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:35.853825 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:35.900132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd734e16d608948b1b3939984b5bd54e6', 'request_id': 'req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.905781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd734e16d608948b1b3939984b5bd54e6', 'request_id': 'req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.911835 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd734e16d608948b1b3939984b5bd54e6', 'request_id': 'req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.925980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] The token cache is being invalidate because project d734e16d608948b1b3939984b5bd54e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:17:35.926271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.926938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:35.928726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1252/2494] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:17:35 2022] DELETE /identity/v3/projects/d734e16d608948b1b3939984b5bd54e6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:35.932865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:35.935055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:35.947890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0b84-1324-4748-aa91-b0291767ef09 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.005270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.005932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.006278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.006537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] PATH_INFO: `/v3/users/a07b54ebc7b147b89b84087381209e80` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.007661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07b54ebc7b147b89b84087381209e80)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.009614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.057842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07b54ebc7b147b89b84087381209e80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.064197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:36.066237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07b54ebc7b147b89b84087381209e80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.067357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07b54ebc7b147b89b84087381209e80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.068633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07b54ebc7b147b89b84087381209e80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.078595 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9842b40f-0df3-4b4f-8f82-e7fcaff502d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07b54ebc7b147b89b84087381209e80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.098224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1243/2495] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:17:35 2022] DELETE /identity/v3/users/a07b54ebc7b147b89b84087381209e80 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:17:36.275006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.276415 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:36.292115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1eb4-a6e2-4006-9ef3-395d761e5c8e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.346086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:36.354520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.355241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.356410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.357406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] PATH_INFO: `/v3/projects/ac5d192b40ed42a4accd640e6e199294` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.358674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5d192b40ed42a4accd640e6e199294)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.360883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.406847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5d192b40ed42a4accd640e6e199294', 'request_id': 'req-75277254-9ba8-4f95-b253-2e72b5b8a55a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.412722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5d192b40ed42a4accd640e6e199294', 'request_id': 'req-75277254-9ba8-4f95-b253-2e72b5b8a55a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.419060 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5d192b40ed42a4accd640e6e199294', 'request_id': 'req-75277254-9ba8-4f95-b253-2e72b5b8a55a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.431063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] The token cache is being invalidate because project ac5d192b40ed42a4accd640e6e199294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:17:36.431363 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.432022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-75277254-9ba8-4f95-b253-2e72b5b8a55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:36.433488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1253/2496] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:17:36 2022] DELETE /identity/v3/projects/ac5d192b40ed42a4accd640e6e199294 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:36.438797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.439081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.439356 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.459525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:36.460723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:36.519385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1244/2497] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:36.528327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.528613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.528888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.548152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:36.549345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:36.557189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1254/2498] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:17:36.561463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.571021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504dc83-383b-4e2a-bd5c-cfada0a94a5e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.576240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.576840 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.577121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.577394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.578071 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:17:36.578374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.579961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.592211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1245/2499] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:17:36.596668 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.605858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282fa58-2eec-4f8a-9eb2-5fba63626ba0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.610458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.611049 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.611333 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.611610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.612234 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.614174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.642741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1255/2500] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:17:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:36.647037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.657664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3db84-94d8-43de-9b63-07d74f712f05 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.714028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.714632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.714974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.715744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.716532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.718501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.742015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1246/2501] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:17:36 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:36.743471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.754883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f976f46-f664-41ae-929a-ea8a3efc8237 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.760078 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.760693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.760979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.761255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.762469 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.764180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.774278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1256/2502] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:17:36.778949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.788898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4e98-d550-4794-887e-b4da825cae7a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.793580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.794177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.794461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.794740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.795408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.797017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e45de-078e-4361-b627-b22979d64ddb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.807516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1247/2503] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:36.812723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.822696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd58eb-826c-4118-94a1-2358c128be1d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:36.827353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:36.827995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.828280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.828551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] PATH_INFO: `/v3/projects/692178010ed841ef989712486d2f7a2d/users/2d94954c99d24dbaa0517ccc312085da/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.843416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692178010ed841ef989712486d2f7a2d, user_id=2d94954c99d24dbaa0517ccc312085da, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:36.846076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:36.858963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1257/2504] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:36 2022] PUT /identity/v3/projects/692178010ed841ef989712486d2f7a2d/users/2d94954c99d24dbaa0517ccc312085da/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:36.863914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58f10-a898-463e-b76b-b0a0f8aad94c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:36.864206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58f10-a898-463e-b76b-b0a0f8aad94c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:36.864513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58f10-a898-463e-b76b-b0a0f8aad94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:36.883395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-28c58f10-a898-463e-b76b-b0a0f8aad94c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:36.884584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-28c58f10-a898-463e-b76b-b0a0f8aad94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:36.917715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:36.946269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1248/2505] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:17:36.956052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:36.957785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:37.014039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483fe1-4142-483b-8a15-d74ae04b9213 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:37.017728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:37.018327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:37.018607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:37.018881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:37.028230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:37.029689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:37.038976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1258/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:41.191205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.191752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.191979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.225701 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] MFA Rules not processed for user `2d94954c99d24dbaa0517ccc312085da`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:41.226772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:41.361154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1249/2507] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:41.362355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.381744 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5ab67-1542-4af0-8acc-96134c9e3252 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.387272 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.387976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.388324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.388820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.389743 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.391463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.422971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1259/2508] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:17:41 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:41.427727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.438935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666f5c9-1c79-43de-9c3c-d73adbd306ef None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.525588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.526230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.526513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.526788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.528268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.530283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.558816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1250/2509] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:17:41 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:41.561002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.568082 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:41.572109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec685-00bf-4783-88ec-1e64e04aafaa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.581778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.582397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.582676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.582943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.583589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.585223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.597818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1260/2510] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:41.601934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.613228 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6c34-4add-4e0b-9a75-f3160f82230b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.618416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.619084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.619364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.619632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] PATH_INFO: `/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3/users/3282be75787a497e90c11ad20b6ea5ea/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.635780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a5f079d834eec98e1f7ef7e2a08e3, user_id=3282be75787a497e90c11ad20b6ea5ea, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.639103 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.654131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1251/2511] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:41 2022] PUT /identity/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3/users/3282be75787a497e90c11ad20b6ea5ea/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:41.658119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.668471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c48ec-ff90-4e27-9a7c-54921a0646e0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.729549 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.730178 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.730532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.730810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.731456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.733062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7431-3c65-42e4-9b81-67c10b81136e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.744204 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1261/2512] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:41.748709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:41.763562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324fc7-73ce-40e0-bc45-04bd4b48fa86 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:41.768866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:41.769860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:41.770146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:41.770416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] PATH_INFO: `/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3/users/3282be75787a497e90c11ad20b6ea5ea/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:41.772597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a5f079d834eec98e1f7ef7e2a08e3, user_id=3282be75787a497e90c11ad20b6ea5ea, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:41.775280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:41.787189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1252/2513] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:41 2022] PUT /identity/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3/users/3282be75787a497e90c11ad20b6ea5ea/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:46.179278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653ac9-ee66-41ec-878a-66f71fb37882 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:46.180395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653ac9-ee66-41ec-878a-66f71fb37882 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:46.180947 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653ac9-ee66-41ec-878a-66f71fb37882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:46.240360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a7653ac9-ee66-41ec-878a-66f71fb37882 None None] MFA Rules not processed for user `3282be75787a497e90c11ad20b6ea5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:46.241806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a7653ac9-ee66-41ec-878a-66f71fb37882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:46.313734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1262/2514] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:46.327853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:46.329661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:46.352762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:46.424630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68add5-78f7-4e4e-b535-fb239b3ab4ea admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:46.432213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:46.432927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:46.433985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:46.434379 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:46.511751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:46.513292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:46.523332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1253/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:47.608114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:47.609026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:47.609302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:47.638382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] MFA Rules not processed for user `2d94954c99d24dbaa0517ccc312085da`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:47.639680 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:47.647065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1263/2516] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:56.519059 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=47 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:57.634184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=69 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:02.378527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:02.380180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:02.460013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917675b-595e-4de3-8e23-7f4ed07edcf0 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:02.465162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:02.466058 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:02.466442 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:02.466810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:02.469769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:02.481809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:02.483267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:02.492099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1254/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:18:06.538614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:06.550856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b8fd-ec24-4c65-91ff-d0ae2707d198 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:06.555450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:06.556148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:06.556520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:06.556865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:06.558873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:06.625993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:06.627463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:06.638493 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1264/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:10.003787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.005397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:10.020953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b421-4ac7-41fb-906f-eaeb571e4203 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.027528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.028265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.028573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.028847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] PATH_INFO: `/v3/users/049df06cc2454185b611ff75538f7877` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.030099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049df06cc2454185b611ff75538f7877)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.032069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.080363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049df06cc2454185b611ff75538f7877'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.087579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049df06cc2454185b611ff75538f7877'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.088285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049df06cc2454185b611ff75538f7877'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.089323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049df06cc2454185b611ff75538f7877'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.101085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aad50342-bc7d-4cd4-bae3-4c7128e59709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049df06cc2454185b611ff75538f7877'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.121190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1255/2519] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:10 2022] DELETE /identity/v3/users/049df06cc2454185b611ff75538f7877 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:10.305789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.316858 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5cbdd-3367-437d-a5cf-7a77d6ec3db8 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.378261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.378909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.379191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.379464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] PATH_INFO: `/v3/projects/9b268f98bcec4e2a8196528ab5531dfd` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.380580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b268f98bcec4e2a8196528ab5531dfd)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.382550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.430655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b268f98bcec4e2a8196528ab5531dfd', 'request_id': 'req-7fd67503-c28b-4934-82b7-6230c36c2532'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.437188 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b268f98bcec4e2a8196528ab5531dfd', 'request_id': 'req-7fd67503-c28b-4934-82b7-6230c36c2532'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.443875 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b268f98bcec4e2a8196528ab5531dfd', 'request_id': 'req-7fd67503-c28b-4934-82b7-6230c36c2532'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.456422 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] The token cache is being invalidate because project 9b268f98bcec4e2a8196528ab5531dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:10.456709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.457321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7fd67503-c28b-4934-82b7-6230c36c2532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:10.458842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1265/2520] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:10 2022] DELETE /identity/v3/projects/9b268f98bcec4e2a8196528ab5531dfd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:10.464226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.464513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.464795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.486135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:10.487280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:10.547502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1256/2521] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:10.556056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.556369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.556648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.577107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:10.578329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:10.586713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1266/2522] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:10.591474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.601062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af44b3-3b26-4a81-8a8e-be5990a64c3b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.606452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.607064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.607350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.607628 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.608280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:10.608586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.610235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.622258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1257/2523] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:10.626570 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.638580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493bb51-6ed5-4ea9-9ddd-f2ec42b29174 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.643419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.644026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.644306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.644581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.645255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.647196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.663604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:10.677946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1267/2524] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:10.682229 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.687639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:10.697077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0666-346f-4855-9546-74c30606669a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.769299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.770026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.770374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.771161 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.771465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.773729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.809557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1258/2525] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:10 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:10.813783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.827399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980bc9-0f0d-426b-8bae-2a3e19485526 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.833329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.834129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.834364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.834958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.838119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.841719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.853540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1268/2526] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:10.857748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.867699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c223a-90e7-416f-8623-c8b59fd7bc3b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.874093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.874284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.874535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.874814 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.875502 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.877091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e171726-046b-4968-873f-261ca54a2df9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.891126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1259/2527] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:10.892844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:10.903186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eba5b-d1b9-4a18-a3d1-dda97da4cb8f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:10.907801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:10.908443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.908723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.908991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] PATH_INFO: `/v3/projects/dc00af8b88ec4749b19d58c8fd478d80/users/f9e7464fb9414d53940c77758b8f73cb/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.925238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc00af8b88ec4749b19d58c8fd478d80, user_id=f9e7464fb9414d53940c77758b8f73cb, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:10.927975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:10.942217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1269/2528] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:10 2022] PUT /identity/v3/projects/dc00af8b88ec4749b19d58c8fd478d80/users/f9e7464fb9414d53940c77758b8f73cb/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:10.953055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:10.953370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:10.953700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:10.985810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] MFA Rules not processed for user `f9e7464fb9414d53940c77758b8f73cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:10.987119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:11.054955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1260/2529] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:11.061138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.143845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97428f-bc2e-4f96-bc9f-b4043082885f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.150412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.151103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.151386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.151665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.152727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.154262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.199127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1270/2530] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:11 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:11.201450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.212144 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5d07d-cace-44ae-b580-b92b7fc3abfb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.278368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.278983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.279268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.279545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.280177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.282169 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.298917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:11.303640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1261/2531] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:11 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:11.308226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.318613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69b4e-b5f7-43ba-a716-72b4778a522f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.323327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.323921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.324205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.324481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.325126 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.326751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.337361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1271/2532] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:11.342195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.351977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d258bb-37e5-4ab1-aa2f-681fa0ebf693 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.358441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.359084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.359364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.359638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] PATH_INFO: `/v3/projects/d3330ce6786e4b71b54158199b624c18/users/295b383643f846bebac3c2b8e8cf8d80/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.374581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3330ce6786e4b71b54158199b624c18, user_id=295b383643f846bebac3c2b8e8cf8d80, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.378421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.391830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1262/2533] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:11 2022] PUT /identity/v3/projects/d3330ce6786e4b71b54158199b624c18/users/295b383643f846bebac3c2b8e8cf8d80/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:11.395895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.406586 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb1e9-7ea0-48eb-8ca0-59a3895ee114 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.461899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.462500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.462775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.463043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.464170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.465785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3e7d6-e370-44bd-85e3-3a17be99c34d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.475461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1272/2534] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:11.480650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.490821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24828b-ea7e-4467-b9cc-bada2a800ffd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.495789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.496431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.496710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.496981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] PATH_INFO: `/v3/projects/d3330ce6786e4b71b54158199b624c18/users/295b383643f846bebac3c2b8e8cf8d80/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.498890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3330ce6786e4b71b54158199b624c18, user_id=295b383643f846bebac3c2b8e8cf8d80, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.501496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.511774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1263/2535] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:11 2022] PUT /identity/v3/projects/d3330ce6786e4b71b54158199b624c18/users/295b383643f846bebac3c2b8e8cf8d80/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:11.523191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.523482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.523752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.551267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] MFA Rules not processed for user `295b383643f846bebac3c2b8e8cf8d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:11.552458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:11.570274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:11.621579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1273/2536] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:11.632400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:11.634133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:11.690968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe672b-3724-4d42-ad73-ae54b075fd77 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:11.694618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:11.695220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:11.695513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:11.695779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:11.751645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:11.753102 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:11.762262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1264/2537] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:14.343583 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:14.355600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a213633-05a5-4daa-99af-e385102e98b4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:14.359444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:14.360069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:14.360354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:14.360620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:14.370053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:14.371653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:14.380998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1274/2538] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:18:15.161857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:15.164009 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:15.233448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea2914-64e0-4d87-b2f7-5347d5786cdc service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:15.237545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:15.238203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:15.238481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:15.238760 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:15.240531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:15.273893 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:15.310721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:15.312183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:15.322444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1265/2539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:16.979429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:16.981288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:17.076488 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaf8da-8ffc-4279-aafd-3c873c6c3afe service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:17.084952 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:17.085618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:17.086228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:17.086507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:17.088514 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:17.109108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:17.110970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:17.124911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1275/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:18.033723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:18.043001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991940-8ba6-4c0c-a558-944a260c24fa service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:18.046596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:18.047242 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:18.047515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:18.047790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:18.049570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:18.114350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:18.115778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:18.126163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1266/2541] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:21.268058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:21.269544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:21.356239 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:21.357862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:21.368766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446edbb0-be09-41b7-be88-7d02185db254 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:21.373092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d94d-1482-478d-9049-9aaf845b174c service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:21.374636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:21.375253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.375538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.375812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.377564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:21.378096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:21.378816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.379306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.379885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] PATH_INFO: `/v3/users/c68a9247d24247c5ab68e929625bac4e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.381171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68a9247d24247c5ab68e929625bac4e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:21.383290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:21.400005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:21.401931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:21.412094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1276/2542] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:21.439222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68a9247d24247c5ab68e929625bac4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.447187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68a9247d24247c5ab68e929625bac4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.448025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68a9247d24247c5ab68e929625bac4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.448697 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68a9247d24247c5ab68e929625bac4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.456136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff4e75ea-a452-4315-bdd3-db612d0a3b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68a9247d24247c5ab68e929625bac4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.473603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1267/2543] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:21 2022] DELETE /identity/v3/users/c68a9247d24247c5ab68e929625bac4e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:21.646983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:21.660473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf5d6-9bac-4093-a9f1-21f3aef9d190 service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:21.676172 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:21.723024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:21.723655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.724051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.724331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] PATH_INFO: `/v3/projects/f4545265a4da4494a9bba43ff4e3d82b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.725431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4545265a4da4494a9bba43ff4e3d82b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:21.727393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:21.774327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4545265a4da4494a9bba43ff4e3d82b', 'request_id': 'req-95e3c227-ba3c-4907-862c-558ff4f0bd9a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.780565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4545265a4da4494a9bba43ff4e3d82b', 'request_id': 'req-95e3c227-ba3c-4907-862c-558ff4f0bd9a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.786918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4545265a4da4494a9bba43ff4e3d82b', 'request_id': 'req-95e3c227-ba3c-4907-862c-558ff4f0bd9a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.799317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] The token cache is being invalidate because project f4545265a4da4494a9bba43ff4e3d82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:21.799603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.800214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-95e3c227-ba3c-4907-862c-558ff4f0bd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:21.801697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1277/2544] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:21 2022] DELETE /identity/v3/projects/f4545265a4da4494a9bba43ff4e3d82b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:21.806599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.806887 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.807164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.827567 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:21.828768 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:21.861017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:21.893696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1268/2545] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:21.902268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.902562 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.902870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.924044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:21.925256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:21.933726 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1278/2546] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:21.937806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:21.947688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c534379-a873-41bb-860b-1348cf1116e0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:21.952355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:21.952953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.953237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.953536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.954181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:21.954483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:21.956069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:21.968545 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1269/2547] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:21.972746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:21.982811 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7793-39fe-407e-811e-163cfe53ee25 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:21.987489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:21.988080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:21.988365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:21.988641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:21.989276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:21.991217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.018250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1279/2548] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:21 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:22.022651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.033288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317750f-7ed3-45c8-ad6e-f8d787643144 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.095464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.096365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.096830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.097264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.098191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.100331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.130640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1270/2549] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:22 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:22.131728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.143141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c6a4-9d6b-4034-ad34-ae29aeb5bbf9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.152818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.152818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.152818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.152818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.153214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.153214 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.164348 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1280/2550] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:22.169010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.179797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b8e0-9492-49e7-92ec-025adc77aa99 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.185284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.185977 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.186241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.186583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.187907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.189654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6de3-7284-45b1-b02e-31bd67e255bc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.206148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1271/2551] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:22.207011 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.218245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a0a2-40c0-4ae5-ac04-07ed105c4ecf admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.222996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.223650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.223933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.224207 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] PATH_INFO: `/v3/projects/35d728c6c7de4b91864f46fb7db74839/users/8121c93a643a4ed897a8ef607f0a5c25/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.243393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d728c6c7de4b91864f46fb7db74839, user_id=8121c93a643a4ed897a8ef607f0a5c25, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.247665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.264771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1281/2552] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:22 2022] PUT /identity/v3/projects/35d728c6c7de4b91864f46fb7db74839/users/8121c93a643a4ed897a8ef607f0a5c25/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:22.276289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.276871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.277154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.325763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] MFA Rules not processed for user `8121c93a643a4ed897a8ef607f0a5c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:22.327267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:22.405222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1272/2553] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:22.409822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.457203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:22.476881 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d76de-80b3-49e7-a0c7-cabe1fe4b130 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.483004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.483796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.484075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.484346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.485010 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.487002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.514615 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1282/2554] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:22 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:22.518716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.529859 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c4e7-4526-4c70-becd-9cb41c18a047 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.555613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:22.587995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.589052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.589332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.589664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.590341 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.592292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.612573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1273/2555] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:22 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:22.616550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.627713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70686d60-27ff-42d3-b45f-be1c03231a74 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.632310 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.632911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.633189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.633461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.634137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.636522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.647007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1283/2556] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:22.651304 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.661155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f16f-11f7-4d93-9dcb-204980eb3071 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.665774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.666462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.666745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.667022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] PATH_INFO: `/v3/projects/125f62ddeadb4a349d72d6fdbd328052/users/d804dd6ea65e47ca851b80830ca34961/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.682246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125f62ddeadb4a349d72d6fdbd328052, user_id=d804dd6ea65e47ca851b80830ca34961, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.685094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.698495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1274/2557] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:22 2022] PUT /identity/v3/projects/125f62ddeadb4a349d72d6fdbd328052/users/d804dd6ea65e47ca851b80830ca34961/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:22.702676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.713004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfe713-d281-45c2-a62d-369f1a0c1bfc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.768502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.769139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.769448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.769745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.770381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.772113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6a99-78af-4dbf-8882-e17686bf4b4e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.782195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1284/2558] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:22.786561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.797395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb323-622d-459e-bdae-c48de0008289 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:22.801981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:22.802619 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.802899 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.803176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] PATH_INFO: `/v3/projects/125f62ddeadb4a349d72d6fdbd328052/users/d804dd6ea65e47ca851b80830ca34961/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.805024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] RBAC: Authorizing `identity:create_grant(project_id=125f62ddeadb4a349d72d6fdbd328052, user_id=d804dd6ea65e47ca851b80830ca34961, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:22.808072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:22.817854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1275/2559] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:22 2022] PUT /identity/v3/projects/125f62ddeadb4a349d72d6fdbd328052/users/d804dd6ea65e47ca851b80830ca34961/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:22.829470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:22.829849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:22.830119 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:22.860619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] MFA Rules not processed for user `d804dd6ea65e47ca851b80830ca34961`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:22.861855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:22.928061 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1285/2560] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:22.939178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:22.940841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:22.999653 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13286-c178-4f81-b8d4-4631922d538d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:23.003292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:23.003888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.004163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.004431 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.013998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:23.015423 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960dacd-23d4-46e6-a5f0-f50f42371535 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:23.024549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1276/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:22 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:23.159676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:23.201450 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:23.222362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146cf96-2541-402b-9800-c86e6b942493 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:23.226874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:23.227500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.227785 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.228065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] PATH_INFO: `/v3/users/8121c93a643a4ed897a8ef607f0a5c25` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.229270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8121c93a643a4ed897a8ef607f0a5c25)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:23.231275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:23.277243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8121c93a643a4ed897a8ef607f0a5c25'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.284248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8121c93a643a4ed897a8ef607f0a5c25'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.284901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8121c93a643a4ed897a8ef607f0a5c25'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.292046 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8121c93a643a4ed897a8ef607f0a5c25'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.304226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8121c93a643a4ed897a8ef607f0a5c25'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.311190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1286/2562] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:23 2022] DELETE /identity/v3/users/8121c93a643a4ed897a8ef607f0a5c25 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:23.315864 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.316098 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.316374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.336023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:23.337330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:23.401951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1277/2563] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:18:23.413229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:23.414637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:23.475413 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f32dc-f648-42b0-ba18-ad13f7debec3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:23.479353 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:23.479964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.480246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.480522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.489769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:23.491149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:23.503192 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1287/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:23.787367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:23.788869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:23.801796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e6cf-b926-46c3-9d34-2fa415eec5a6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:23.806548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:23.807825 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.808100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.808367 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] PATH_INFO: `/v3/projects/35d728c6c7de4b91864f46fb7db74839` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.809526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d728c6c7de4b91864f46fb7db74839)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:23.811454 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:23.837019 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:23.868780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d728c6c7de4b91864f46fb7db74839', 'request_id': 'req-290533fb-8a23-4e99-9ee1-8696e06333ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.874515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d728c6c7de4b91864f46fb7db74839', 'request_id': 'req-290533fb-8a23-4e99-9ee1-8696e06333ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.880681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d728c6c7de4b91864f46fb7db74839', 'request_id': 'req-290533fb-8a23-4e99-9ee1-8696e06333ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.894164 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] The token cache is being invalidate because project 35d728c6c7de4b91864f46fb7db74839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:23.894479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.895094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:23.896579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1278/2565] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:23 2022] DELETE /identity/v3/projects/35d728c6c7de4b91864f46fb7db74839 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:23.901182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:23.910711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce882f2b-9f06-4201-8d38-231edd9f4f5b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:23.966833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:23.967474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:23.967760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:23.968034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] PATH_INFO: `/v3/users/d804dd6ea65e47ca851b80830ca34961` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:23.969153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d804dd6ea65e47ca851b80830ca34961)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:23.971111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:23.973410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:24.020455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd804dd6ea65e47ca851b80830ca34961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.028006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd804dd6ea65e47ca851b80830ca34961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.028659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd804dd6ea65e47ca851b80830ca34961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.035966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd804dd6ea65e47ca851b80830ca34961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.048144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-08199e0b-1999-4f33-bcbb-331a355ac829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd804dd6ea65e47ca851b80830ca34961'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.053960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1288/2566] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:23 2022] DELETE /identity/v3/users/d804dd6ea65e47ca851b80830ca34961 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:24.332220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.333747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:24.349577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290533fb-8a23-4e99-9ee1-8696e06333ce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.414296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.414851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.415130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.415404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] PATH_INFO: `/v3/projects/125f62ddeadb4a349d72d6fdbd328052` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.417104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125f62ddeadb4a349d72d6fdbd328052)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.419047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.465032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125f62ddeadb4a349d72d6fdbd328052', 'request_id': 'req-874e3b45-b6de-4053-9e2e-b6cc5565b477'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.470625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125f62ddeadb4a349d72d6fdbd328052', 'request_id': 'req-874e3b45-b6de-4053-9e2e-b6cc5565b477'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.476623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125f62ddeadb4a349d72d6fdbd328052', 'request_id': 'req-874e3b45-b6de-4053-9e2e-b6cc5565b477'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.490093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] The token cache is being invalidate because project 125f62ddeadb4a349d72d6fdbd328052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:24.490413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.491037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-874e3b45-b6de-4053-9e2e-b6cc5565b477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:24.492537 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1279/2567] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:24 2022] DELETE /identity/v3/projects/125f62ddeadb4a349d72d6fdbd328052 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:24.498406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.498911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.499035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.518838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:24.520020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:24.578754 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1289/2568] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:24.586833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.587125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.587403 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.608433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:24.609770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:24.618087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1280/2569] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:24.623268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.633557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6730-9955-4517-9dfe-f5e46ad8fd1e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.638642 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.639245 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.639524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.639792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.640460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:24.640763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.642526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.655390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1290/2570] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:24.659802 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.670244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fc13-d661-4344-96c1-367071e42cb4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.675042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.675649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.675930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.676204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.676873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.678807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.709666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1281/2571] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:24.713913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.724144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd31fa-d438-4aae-b626-b8dad15fdc8a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.788216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.788834 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.789111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.789379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.790039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.792646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.809720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:24.818014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1291/2572] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:24 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:24.821057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.831780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd179d51-2036-4f8c-a397-4f12d6dc56fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.837116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.838512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.838798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.839212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.839874 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.841489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.843726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:24.856889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1282/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:24.858892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.870930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c0f26-754b-4fc8-aae4-e35e12d6008a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.875597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.876244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.876476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.876752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.877396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.879132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4c53-a1a5-4b38-81cb-035acbada1e4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.890406 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1292/2574] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:24.894781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:24.905395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342d8c-0362-4b22-ba66-af1291d4689f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:24.910109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:24.910766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.911047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.911323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] PATH_INFO: `/v3/projects/3bda1fff293a478f97fa540abc5062ca/users/93f64f0731364d05a105b7238c32fe9d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.929157 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda1fff293a478f97fa540abc5062ca, user_id=93f64f0731364d05a105b7238c32fe9d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:24.932428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:24.945622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1283/2575] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:24 2022] PUT /identity/v3/projects/3bda1fff293a478f97fa540abc5062ca/users/93f64f0731364d05a105b7238c32fe9d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:24.956142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:24.956357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:24.956631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:24.985420 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] MFA Rules not processed for user `93f64f0731364d05a105b7238c32fe9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:24.986674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:25.057550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1293/2576] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:25.061957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.126330 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda432ea-85fa-4895-922e-5f0a257dfb41 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.131961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.132570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.132851 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.133124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.133810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.136268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.162832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1284/2577] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:25 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:25.167619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.178438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faaafc-a935-4229-a7c6-1e8bd8e4ccfb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.238763 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.239364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.239646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.239924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.240542 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.242511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.264096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1294/2578] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:25 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:25.267602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.278023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9253c0-cf46-489b-9557-3d8e0fe091b4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.282542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.283133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.283411 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.283680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.284381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.286081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.297759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1285/2579] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:25.301629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.312991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377222bd-0f95-4eeb-bac8-5339800de63b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.317799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.318456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.318760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.319036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] PATH_INFO: `/v3/projects/03b46c66735c4b7cbadc4a5e0e178042/users/cc245b7fee5e4768af9b1bff90034e17/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.333907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b46c66735c4b7cbadc4a5e0e178042, user_id=cc245b7fee5e4768af9b1bff90034e17, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.336800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.349722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1295/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:25 2022] PUT /identity/v3/projects/03b46c66735c4b7cbadc4a5e0e178042/users/cc245b7fee5e4768af9b1bff90034e17/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:25.354853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.365094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0a173-c9fa-443f-8e96-d0bf2653c82b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.422248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.422757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.423037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.423308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.423936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.425527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6776c03-c762-42cf-9a8e-31425c6332f5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.435833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1286/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:25.439945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.450433 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d7a97-ca69-45f7-8e07-89a529bcc7f7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.454998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.455636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.455910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.456179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] PATH_INFO: `/v3/projects/03b46c66735c4b7cbadc4a5e0e178042/users/cc245b7fee5e4768af9b1bff90034e17/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.458107 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b46c66735c4b7cbadc4a5e0e178042, user_id=cc245b7fee5e4768af9b1bff90034e17, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.460959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.471092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1296/2582] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:25 2022] PUT /identity/v3/projects/03b46c66735c4b7cbadc4a5e0e178042/users/cc245b7fee5e4768af9b1bff90034e17/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:25.483138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.483426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.483704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.513434 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] MFA Rules not processed for user `cc245b7fee5e4768af9b1bff90034e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:25.514687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:25.548752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:25.585204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1287/2583] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:25.597713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.599484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:25.631625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:25.659190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f444fd-4c5d-4cba-8807-124c5af796d2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.662877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.663500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.663796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.664071 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.673890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.675300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.685435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1297/2584] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:25.764517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:25.774222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3dde-ff1a-4eec-bfb3-0717cea77b21 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:25.778608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:25.779211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:25.779496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:25.779772 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:25.840064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:25.841603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb85f6-1520-48ab-b8e4-ace9d01d555b service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:25.850908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1288/2585] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:27.210005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:27.211704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:27.282516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec930-ca08-4eba-b3bb-4e627a6edd71 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:27.287004 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:27.287635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:27.287917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:27.288191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] PATH_INFO: `/v3/users/f9e7464fb9414d53940c77758b8f73cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:27.289873 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e7464fb9414d53940c77758b8f73cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:27.293153 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:27.348213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e7464fb9414d53940c77758b8f73cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.358347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e7464fb9414d53940c77758b8f73cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.359189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e7464fb9414d53940c77758b8f73cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.370218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e7464fb9414d53940c77758b8f73cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.385465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e7464fb9414d53940c77758b8f73cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.392489 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1298/2586] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:27 2022] DELETE /identity/v3/users/f9e7464fb9414d53940c77758b8f73cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:27.398248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:27.399115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:27.399692 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:27.438003 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:27.439201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:27.508807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1289/2587] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:27.518916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:27.520244 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:27.578925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b70d-7cdf-4449-a62d-c15e5e2c4602 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:27.583327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:27.584268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:27.584557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:27.584970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:27.592291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:27.597250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:27.599626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:27.610937 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1299/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:27.881759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:27.883324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:27.895737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc1e6-f783-48c0-93b0-a7325ab2013c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:27.900535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:27.901406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:27.901734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:27.902004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] PATH_INFO: `/v3/projects/dc00af8b88ec4749b19d58c8fd478d80` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:27.903138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc00af8b88ec4749b19d58c8fd478d80)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:27.905179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:27.953381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc00af8b88ec4749b19d58c8fd478d80', 'request_id': 'req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.959162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc00af8b88ec4749b19d58c8fd478d80', 'request_id': 'req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.966387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc00af8b88ec4749b19d58c8fd478d80', 'request_id': 'req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.968190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:27.980312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] The token cache is being invalidate because project dc00af8b88ec4749b19d58c8fd478d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:27.980597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.981209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:27.982738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1290/2589] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:27 2022] DELETE /identity/v3/projects/dc00af8b88ec4749b19d58c8fd478d80 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:27.987027 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:27.997357 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830633-0974-48df-b610-183b9f5fc02a service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.052235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.052790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.053090 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.053351 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] PATH_INFO: `/v3/users/295b383643f846bebac3c2b8e8cf8d80` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.054502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295b383643f846bebac3c2b8e8cf8d80)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.057111 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.105268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295b383643f846bebac3c2b8e8cf8d80'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.112494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295b383643f846bebac3c2b8e8cf8d80'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.113224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295b383643f846bebac3c2b8e8cf8d80'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.121681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295b383643f846bebac3c2b8e8cf8d80'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.133496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35f5a761-533c-4d6c-bc43-d5d480a81544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295b383643f846bebac3c2b8e8cf8d80'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.139411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1300/2590] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:27 2022] DELETE /identity/v3/users/295b383643f846bebac3c2b8e8cf8d80 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:28.414053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.416184 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:28.430171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31095-48c4-4eaa-b7a2-d1ce144cbef9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.492406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.493051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.493334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.493644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] PATH_INFO: `/v3/projects/d3330ce6786e4b71b54158199b624c18` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.494852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3330ce6786e4b71b54158199b624c18)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.496763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.547091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3330ce6786e4b71b54158199b624c18', 'request_id': 'req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.552898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3330ce6786e4b71b54158199b624c18', 'request_id': 'req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.561295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3330ce6786e4b71b54158199b624c18', 'request_id': 'req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.574513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] The token cache is being invalidate because project d3330ce6786e4b71b54158199b624c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:28.574742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.575376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb24c445-6a64-441e-a0ff-68d84a7ce2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:28.576981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1291/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:28 2022] DELETE /identity/v3/projects/d3330ce6786e4b71b54158199b624c18 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:28.582104 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.582656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.582656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.604658 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:28.605902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:28.668114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1301/2592] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:28.676383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.676721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.677055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.698553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:28.699953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:28.709688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1292/2593] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:18:28.713054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.723213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b4dbd-ad51-4c35-b288-931b4d01c63b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.727945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.729086 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.729364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.729677 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.730432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:28.730813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.732592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.741312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:28.745440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1302/2594] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:28.749882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.759453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ba39-2ed7-457a-ae3b-abf5330a5211 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.764850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.765630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.765912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.766181 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.766928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.769134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.802413 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1293/2595] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:28.803515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.815043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118286f-0b14-4648-aa83-567f2e2d7310 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.875174 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.875783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.876068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.876344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.876978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.878925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.899803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1303/2596] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:28 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:28.904715 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.915017 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d46f43-6e76-48f4-8c9d-4fe1041c887d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.920328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.920914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.921202 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.921473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.922154 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.923739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.934053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1294/2597] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:28.937979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.948052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ada47-8530-4f2f-8f8a-2578dbda1708 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.952786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.953370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.953675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.953951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:28.954587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:28.956182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e4802-3047-434f-83ec-32d482a3d899 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:28.967494 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1304/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:28.971590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:28.982195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b156-11a8-4b37-8fc8-c967023c83aa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:28.986763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:28.987397 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:28.987679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:28.987954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] PATH_INFO: `/v3/projects/d9f963fdb1a24176be0c5105f5eec1b8/users/f2c3a84edb524d2cb79a71e427231942/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.002430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f963fdb1a24176be0c5105f5eec1b8, user_id=f2c3a84edb524d2cb79a71e427231942, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:29.005078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:29.017636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1295/2599] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:28 2022] PUT /identity/v3/projects/d9f963fdb1a24176be0c5105f5eec1b8/users/f2c3a84edb524d2cb79a71e427231942/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:29.029897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.030183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.030455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.058201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] MFA Rules not processed for user `f2c3a84edb524d2cb79a71e427231942`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:29.059460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:29.125938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1305/2600] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:29.137783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:29.139482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:29.160824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:29.199249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970eb5-e2f7-4aa3-9854-ad69323ff4ce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:29.202930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:29.203540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.203822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.204109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.213145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:29.214770 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a9e4-6e61-42c8-917e-3511600380d9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:29.223826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1296/2601] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:29.243389 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:29.304366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70875cd4-e47b-4dbb-b3a6-ac5f26a28b66 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:29.309287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:29.309942 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.310224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.310499 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] PATH_INFO: `/v3/users/f2c3a84edb524d2cb79a71e427231942` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.311679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c3a84edb524d2cb79a71e427231942)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:29.313686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:29.324698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:29.360255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c3a84edb524d2cb79a71e427231942'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.366986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c3a84edb524d2cb79a71e427231942'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.367652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c3a84edb524d2cb79a71e427231942'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.375553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c3a84edb524d2cb79a71e427231942'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.388474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c3a84edb524d2cb79a71e427231942'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.394813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1306/2602] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:29 2022] DELETE /identity/v3/users/f2c3a84edb524d2cb79a71e427231942 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:29.399373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.399661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.400081 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.419733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:29.420929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:29.477951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1297/2603] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:29.488344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:29.489814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:29.548480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ba933-cff3-4551-b447-4d742b147d63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:29.552193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:29.552893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.553180 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.553529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.563764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:29.565197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a7f0c-00fa-430e-a5ed-7d3f4d96985c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:29.574758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1307/2604] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:29.866406 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:29.867992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:29.881925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6e85-fef2-47df-be83-75d7622fbcbd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:29.887453 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:29.888137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.888420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.888696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] PATH_INFO: `/v3/projects/d9f963fdb1a24176be0c5105f5eec1b8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:29.890582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f963fdb1a24176be0c5105f5eec1b8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:29.892648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:29.956965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f963fdb1a24176be0c5105f5eec1b8', 'request_id': 'req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.964625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f963fdb1a24176be0c5105f5eec1b8', 'request_id': 'req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.971313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f963fdb1a24176be0c5105f5eec1b8', 'request_id': 'req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.985112 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] The token cache is being invalidate because project d9f963fdb1a24176be0c5105f5eec1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:29.985407 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.986062 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cafc924f-b01c-4419-b9af-3b5bfc3a1a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:29.987553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1298/2605] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:29 2022] DELETE /identity/v3/projects/d9f963fdb1a24176be0c5105f5eec1b8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:29.992600 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:29.993131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:29.993131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.012980 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:30.014220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:30.076246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1308/2606] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:30.083982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.084278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.084558 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.110333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:30.111544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:30.120827 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1299/2607] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:30.125219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.135248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf781-d998-4204-b7f6-59d9a4829690 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.141314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.142039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.142324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.142598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.143253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:30.143622 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.145339 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.157990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1309/2608] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:30.162625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.173204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9652054-d620-4349-889b-55949b74a2a5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.178594 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.179209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.179492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.179860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.180392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.183153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.212542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1300/2609] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:30.216630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.227434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501779df-550c-475b-a63b-f26ef907e55d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.244411 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:30.295757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.296536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.297036 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.297440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.298260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.300336 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.327545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1310/2610] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:30.328806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.340245 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f35a2-bddc-488c-a421-e8b692246cdd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.344904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.345533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.345821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.346096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.346766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.348344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.360997 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1301/2611] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:30.366579 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.377561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3bf8-6e6a-4546-a816-2d8325e37869 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.382345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.382946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.383263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.383538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.384179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.386678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abc148-1f8f-4a32-ac4d-82db82fffaa9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.397452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1311/2612] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:30.402683 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.409438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:30.414028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075976a-eee3-4486-91b7-d487eb7dba80 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.422094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.422915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.423209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.423492 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] PATH_INFO: `/v3/projects/4de6d921616145608a47a4c49af9ab84/users/49dc609685774a38aa0b2002da986678/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.440654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de6d921616145608a47a4c49af9ab84, user_id=49dc609685774a38aa0b2002da986678, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.444050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.459080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1302/2613] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:30 2022] PUT /identity/v3/projects/4de6d921616145608a47a4c49af9ab84/users/49dc609685774a38aa0b2002da986678/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:30.470748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.471074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.471424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.501996 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] MFA Rules not processed for user `49dc609685774a38aa0b2002da986678`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:30.503227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:30.566938 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1312/2614] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:30.571608 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.633121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df294df-f269-487f-9ec5-30bf036a481d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.638682 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.639287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.639572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.639849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.640482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.642435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.667903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1303/2615] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:30.672151 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.683424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158dfb-7ea4-49ca-8cb9-260623e24a01 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.739526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.740055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.740394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.740674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.741309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.743266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.765654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1313/2616] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:30.769796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.780192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f66d5a-c17a-41b1-9bfd-ecaf71e27e21 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.785096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.785736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.786025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.786301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.786975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.788563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.799612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1304/2617] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:30.803895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.814795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2007-6c9d-48e4-874b-f5a5a7c85e1d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.819457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.820103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.820388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.820665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] PATH_INFO: `/v3/projects/f55cbcbc1919460e98546ab77dbd6d99/users/6ce05430e44c4d23ba1308e3bc8a3b38/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.832681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:30.836262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55cbcbc1919460e98546ab77dbd6d99, user_id=6ce05430e44c4d23ba1308e3bc8a3b38, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.839956 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.852774 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1314/2618] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:30 2022] PUT /identity/v3/projects/f55cbcbc1919460e98546ab77dbd6d99/users/6ce05430e44c4d23ba1308e3bc8a3b38/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:30.857778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.867961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5fa8d-f336-4fb9-9250-9019db579c79 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.924236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.924845 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.925130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.925402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.926075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.927663 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c2e5-7516-4955-b8b9-4e7014eef416 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.937829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1305/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:30.942035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:30.952599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71582a-723e-4d5f-8561-7fdc0a418dc6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:30.957118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:30.957796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.958074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.958477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] PATH_INFO: `/v3/projects/f55cbcbc1919460e98546ab77dbd6d99/users/6ce05430e44c4d23ba1308e3bc8a3b38/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:30.960347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55cbcbc1919460e98546ab77dbd6d99, user_id=6ce05430e44c4d23ba1308e3bc8a3b38, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:30.963613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:30.973576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1315/2620] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:30 2022] PUT /identity/v3/projects/f55cbcbc1919460e98546ab77dbd6d99/users/6ce05430e44c4d23ba1308e3bc8a3b38/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:30.986315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:30.986610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:30.986970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:31.016495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] MFA Rules not processed for user `6ce05430e44c4d23ba1308e3bc8a3b38`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:31.017659 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:31.058027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:31.090220 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1306/2621] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:31.101643 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:31.103526 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:31.161971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c5d1e-b121-4f8c-a102-b28cd6b7db51 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:31.165580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:31.166453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:31.166733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:31.167002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:31.223334 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:31.224927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf5ef-b460-4c09-8e15-09466fe6a1d6 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:31.233878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1316/2622] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:33.789336 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:33.852192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227b275-8402-4042-b9e9-420409a5ab17 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:33.858824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:33.859482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:33.859767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:33.860043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] PATH_INFO: `/v3/users/49dc609685774a38aa0b2002da986678` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:33.861203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49dc609685774a38aa0b2002da986678)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:33.863206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:33.914170 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49dc609685774a38aa0b2002da986678'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:33.921029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49dc609685774a38aa0b2002da986678'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:33.921728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49dc609685774a38aa0b2002da986678'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:33.922332 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49dc609685774a38aa0b2002da986678'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:33.930133 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49dc609685774a38aa0b2002da986678'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:33.948667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1307/2623] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:33 2022] DELETE /identity/v3/users/49dc609685774a38aa0b2002da986678 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:33.953157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:33.953664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:33.953798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:33.974098 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:33.975299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:34.034067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1317/2624] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:34.044013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:34.045428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:34.104463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3399-f2fc-4fcc-85fe-d7ca0e941154 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:34.108187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:34.108803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:34.109087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:34.109365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:34.118651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:34.120349 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:34.124296 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:34.131552 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1308/2625] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:34.424855 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:34.426428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:34.443761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a51f0-cdfb-415f-9846-33c6f508fe2e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:34.449581 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:34.450326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:34.450605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:34.450872 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] PATH_INFO: `/v3/projects/4de6d921616145608a47a4c49af9ab84` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:34.452382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de6d921616145608a47a4c49af9ab84)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:34.454476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:34.497453 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:34.514979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de6d921616145608a47a4c49af9ab84', 'request_id': 'req-171f4f95-72a5-44b3-a6a7-e6e16901ff76'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.520799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de6d921616145608a47a4c49af9ab84', 'request_id': 'req-171f4f95-72a5-44b3-a6a7-e6e16901ff76'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.527782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de6d921616145608a47a4c49af9ab84', 'request_id': 'req-171f4f95-72a5-44b3-a6a7-e6e16901ff76'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.542381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] The token cache is being invalidate because project 4de6d921616145608a47a4c49af9ab84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:34.542660 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.543317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.544795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1318/2626] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:34 2022] DELETE /identity/v3/projects/4de6d921616145608a47a4c49af9ab84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:34.548914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:34.559317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa737a-b5e9-4824-9284-5aa211069424 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:34.619902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:34.620581 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:34.620858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:34.621127 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] PATH_INFO: `/v3/users/6ce05430e44c4d23ba1308e3bc8a3b38` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:34.622290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce05430e44c4d23ba1308e3bc8a3b38)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:34.624213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:34.671415 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce05430e44c4d23ba1308e3bc8a3b38'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.678420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce05430e44c4d23ba1308e3bc8a3b38'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.679083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce05430e44c4d23ba1308e3bc8a3b38'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.679680 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce05430e44c4d23ba1308e3bc8a3b38'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.688440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-948b4b5d-1acf-4339-b27e-10819901ef35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce05430e44c4d23ba1308e3bc8a3b38'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:34.706378 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1309/2627] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:34 2022] DELETE /identity/v3/users/6ce05430e44c4d23ba1308e3bc8a3b38 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:34.987274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:34.988791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:35.004328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f4f95-72a5-44b3-a6a7-e6e16901ff76 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.063652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.064206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.064480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.064748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] PATH_INFO: `/v3/projects/f55cbcbc1919460e98546ab77dbd6d99` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.065907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55cbcbc1919460e98546ab77dbd6d99)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.067832 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.117018 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55cbcbc1919460e98546ab77dbd6d99', 'request_id': 'req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:35.123383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55cbcbc1919460e98546ab77dbd6d99', 'request_id': 'req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:35.129476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55cbcbc1919460e98546ab77dbd6d99', 'request_id': 'req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:35.142911 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] The token cache is being invalidate because project f55cbcbc1919460e98546ab77dbd6d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:35.143201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:35.143813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e54f54e3-0d39-4b7d-b7a3-4696d55aedca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:35.145303 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1319/2628] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:34 2022] DELETE /identity/v3/projects/f55cbcbc1919460e98546ab77dbd6d99 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:35.151001 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.151503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.151718 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.171803 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:35.173248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:35.238032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1310/2629] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:35.246445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.246728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.247038 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.267599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:35.268808 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:35.276829 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1320/2630] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:35.281185 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.291455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa5e3-d7c2-4161-a12d-f23c2636a78c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.297013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.297661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.297941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.298210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.298877 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:35.299177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.300774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.314785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1311/2631] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:18:35.319084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.328676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b8717-1821-4d54-af5c-8dc0d216d80c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.333669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.334285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.334571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.334869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.335515 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.337750 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.364837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1321/2632] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:35 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:35.369634 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.376197 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:35.380651 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0c89-90ab-4433-90fa-601014b22d36 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.439937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.440540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.440823 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.441097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.441777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.443685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.467678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1312/2633] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:35 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:35.470213 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.481699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cecc-75c9-4b82-afe1-8110e4511df7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.486925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.487519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.487803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.488360 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.489022 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.490687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.504517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1322/2634] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:35.507495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.518587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ed0d-c50f-444e-a2f9-69cb7b0bf239 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.523604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.524238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.524518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.524787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.525666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.527787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c723f10-5f47-4691-a36b-d932fe24f261 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.539852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1313/2635] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:35.545146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.556240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330369-8968-4e3a-bae6-9c8dd3829f1a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.561898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.562556 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.562838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.563117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] PATH_INFO: `/v3/projects/8ad0a9d5e50f47f4aa414b1da5281981/users/a8fd34e28c6140c08894fef2fe15b968/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.565529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:35.581218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad0a9d5e50f47f4aa414b1da5281981, user_id=a8fd34e28c6140c08894fef2fe15b968, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.585374 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.599998 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1323/2636] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:35 2022] PUT /identity/v3/projects/8ad0a9d5e50f47f4aa414b1da5281981/users/a8fd34e28c6140c08894fef2fe15b968/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:35.611354 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.611666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.611981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.642084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] MFA Rules not processed for user `a8fd34e28c6140c08894fef2fe15b968`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:35.643300 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:35.733194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1314/2637] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:18:35.747434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:35.749385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:35.818672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75678e-c16d-4ad0-b10d-1ba22758f850 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:35.822278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742af66-4512-409d-814b-da547d399c40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f19ed5110c5d43bf89d25d1c85d132b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:35.822880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742af66-4512-409d-814b-da547d399c40 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:35.823157 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742af66-4512-409d-814b-da547d399c40 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:35.823427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742af66-4512-409d-814b-da547d399c40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:35.833491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742af66-4512-409d-814b-da547d399c40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:35.835006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742af66-4512-409d-814b-da547d399c40 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:35.844687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1324/2638] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:45.727746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:45.840807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:55.558373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.559812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.627720 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf1313-4262-4da5-bca4-41dc146d61ff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.632331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.632969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.633250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.633546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] PATH_INFO: `/v3/users/93f64f0731364d05a105b7238c32fe9d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.635363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f64f0731364d05a105b7238c32fe9d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.637317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.684237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f64f0731364d05a105b7238c32fe9d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.690913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f64f0731364d05a105b7238c32fe9d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.691572 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f64f0731364d05a105b7238c32fe9d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.692177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f64f0731364d05a105b7238c32fe9d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.700027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f64f0731364d05a105b7238c32fe9d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.719436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1315/2639] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:55 2022] DELETE /identity/v3/users/93f64f0731364d05a105b7238c32fe9d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:55.723880 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.724394 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.724496 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.743670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:55.744890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.803196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1325/2640] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:55.813099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.814529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.877868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9aa26-fe52-4082-b33c-cc4362494ad8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.881654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.882280 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.882563 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.882837 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.893195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.894677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.905731 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1316/2641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:56.198509 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.200092 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:56.216143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c1455-80b3-4dd0-b961-169ef3a5e5fc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.220814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.221446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.221762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.222031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] PATH_INFO: `/v3/projects/3bda1fff293a478f97fa540abc5062ca` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.223603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bda1fff293a478f97fa540abc5062ca)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.225077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.272904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bda1fff293a478f97fa540abc5062ca', 'request_id': 'req-a0e04ce0-7f25-4efe-9597-5de15ea4551e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.278541 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bda1fff293a478f97fa540abc5062ca', 'request_id': 'req-a0e04ce0-7f25-4efe-9597-5de15ea4551e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.284707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bda1fff293a478f97fa540abc5062ca', 'request_id': 'req-a0e04ce0-7f25-4efe-9597-5de15ea4551e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.297731 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] The token cache is being invalidate because project 3bda1fff293a478f97fa540abc5062ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:56.298021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.298641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.300142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1326/2642] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:56 2022] DELETE /identity/v3/projects/3bda1fff293a478f97fa540abc5062ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.304159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.314665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4490-8417-43b5-9fae-ba974a6d742e service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.333714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:56.373660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.374294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.374574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.374850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] PATH_INFO: `/v3/users/cc245b7fee5e4768af9b1bff90034e17` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.375963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc245b7fee5e4768af9b1bff90034e17)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.377953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.428832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc245b7fee5e4768af9b1bff90034e17'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.436395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc245b7fee5e4768af9b1bff90034e17'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.437123 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc245b7fee5e4768af9b1bff90034e17'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.437776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc245b7fee5e4768af9b1bff90034e17'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.445941 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ace242a8-0dd9-411f-9f77-a27b07e08fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc245b7fee5e4768af9b1bff90034e17'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.464571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1317/2643] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:56 2022] DELETE /identity/v3/users/cc245b7fee5e4768af9b1bff90034e17 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.761341 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.762915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:56.781444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e04ce0-7f25-4efe-9597-5de15ea4551e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.841037 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.841715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.842000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.842276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] PATH_INFO: `/v3/projects/03b46c66735c4b7cbadc4a5e0e178042` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.843865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b46c66735c4b7cbadc4a5e0e178042)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.845820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.877523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:56.902031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b46c66735c4b7cbadc4a5e0e178042', 'request_id': 'req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.907461 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b46c66735c4b7cbadc4a5e0e178042', 'request_id': 'req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.913553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b46c66735c4b7cbadc4a5e0e178042', 'request_id': 'req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.925959 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] The token cache is being invalidate because project 03b46c66735c4b7cbadc4a5e0e178042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:56.926243 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.926867 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9223daef-525f-4d0f-90d5-0b0cfaaf55d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:56.928434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1327/2644] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:56 2022] DELETE /identity/v3/projects/03b46c66735c4b7cbadc4a5e0e178042 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.934387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.934900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.935000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.076822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:57.078080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.143550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1318/2645] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:57.151636 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.151923 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.152198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.171946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:57.173143 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.181395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1328/2646] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:57.186208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.195755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101720d-d7e0-488a-87c0-82610f9088c2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.200498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.201092 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.201374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.201674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.202318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:57.202620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.204206 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.215843 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1319/2647] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:57.220133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.229813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256269ff-2815-466f-af34-4e7a34a8e5ed None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.234437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.235034 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.235316 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.235588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.236219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.238139 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.267028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1329/2648] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:57.271097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.281033 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b8cc0-15a4-4b4b-b1df-eb2ba843d963 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.307553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:57.340297 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.340833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.341116 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.341391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.342066 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.343983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.366518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1320/2649] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:57.371451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.381842 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd2143-c39b-4035-a73b-973efdf5e592 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.386481 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.387079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.387362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.387635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.388308 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.390019 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.400518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1330/2650] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:57.404437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.414288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ae5d-2541-432e-a96c-3c23437e00ee admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.419927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.420527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.420811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.421088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.421764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.423347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381886-8a6b-47a6-a8a4-f116b0e64aef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.433200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1321/2651] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:57.437686 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.447782 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b715f-41a7-409a-98f8-4c2628448ad5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.452381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.453025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.453306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.453619 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] PATH_INFO: `/v3/projects/378218624b564a7baa7b24e5909803fb/users/9d6e846cdd994cf5a60308b9ba04f43d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.469246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=378218624b564a7baa7b24e5909803fb, user_id=9d6e846cdd994cf5a60308b9ba04f43d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.472944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.488109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1331/2652] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:57 2022] PUT /identity/v3/projects/378218624b564a7baa7b24e5909803fb/users/9d6e846cdd994cf5a60308b9ba04f43d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:57.500955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.501250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.501584 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.532765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] MFA Rules not processed for user `9d6e846cdd994cf5a60308b9ba04f43d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:57.534052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.604205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1322/2653] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:57.608727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.674966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202056e0-05db-41f8-88e3-dc5da204a27c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.679722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.680331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.681136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.681471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.682094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.684080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.713465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1332/2654] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:57.717529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.728623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71758517-d00d-4d33-8b54-a1485d3138f2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.787338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.787944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.788224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.788494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.789110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.791894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.813620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1323/2655] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:57.817740 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.829761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b00b5-45af-4826-a02a-947fa9f16ab7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.834679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.835290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.835830 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.836114 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.836960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.838624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.850035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1333/2656] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:57.854880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.865526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a45d-1c8f-4706-a64c-8e9ed0b2e003 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.870974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.871629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.871913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.872218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] PATH_INFO: `/v3/projects/f737d2509faf4fed807dd4fd6be96ded/users/d1a5ecbe669a40e0a5f50b541815430c/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.887113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f737d2509faf4fed807dd4fd6be96ded, user_id=d1a5ecbe669a40e0a5f50b541815430c, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.889771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.902279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1324/2657] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:57 2022] PUT /identity/v3/projects/f737d2509faf4fed807dd4fd6be96ded/users/d1a5ecbe669a40e0a5f50b541815430c/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:57.906269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.916791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5b3c7-7c85-41e4-81e0-60bf205cda58 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.936794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:57.973364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.974001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.974278 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.974548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.975177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.976773 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a6dde-0900-4706-88bd-d0bca35c97aa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.987237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1334/2658] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:57.991432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.997778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:58.004089 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad653f-3e01-47c1-9bc6-f45bc0ed01cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.009114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.009835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.010121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.010395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] PATH_INFO: `/v3/projects/f737d2509faf4fed807dd4fd6be96ded/users/d1a5ecbe669a40e0a5f50b541815430c/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.012306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f737d2509faf4fed807dd4fd6be96ded, user_id=d1a5ecbe669a40e0a5f50b541815430c, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.014973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.025265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1325/2659] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:57 2022] PUT /identity/v3/projects/f737d2509faf4fed807dd4fd6be96ded/users/d1a5ecbe669a40e0a5f50b541815430c/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:58.035302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.035598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.035879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.065195 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] MFA Rules not processed for user `d1a5ecbe669a40e0a5f50b541815430c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:58.066486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.136321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1335/2660] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:58.147570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.149896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.214516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48898761-ffb3-4596-a53b-9bb460aa65ef admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.218151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.218781 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.219061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.219331 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.228841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.230283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.239457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1326/2661] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:58.317759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.327429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1447d3d-7b35-45b7-90f1-ec998be5b720 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.331150 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.331749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.332030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.332305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.389407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.390803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d148c7-f17c-4f6f-a7a8-cb8f27e03bac service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.400465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1336/2662] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:58.725834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.727236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.791542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d353d12-5f56-4828-a56c-001f6f496dd2 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.796064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.796691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.796976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.797248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] PATH_INFO: `/v3/users/a8fd34e28c6140c08894fef2fe15b968` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.798464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fd34e28c6140c08894fef2fe15b968)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.800360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.848319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fd34e28c6140c08894fef2fe15b968'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.855267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fd34e28c6140c08894fef2fe15b968'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.856113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fd34e28c6140c08894fef2fe15b968'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.856949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fd34e28c6140c08894fef2fe15b968'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.864470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fd34e28c6140c08894fef2fe15b968'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.881299 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1327/2663] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:58 2022] DELETE /identity/v3/users/a8fd34e28c6140c08894fef2fe15b968 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:58.886464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.886967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.887096 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.907216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:58.908446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.947845 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:58.967187 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1337/2664] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:58.976712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.978205 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.991544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:59.038091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33681-62f6-427a-8f74-ff95efc8e5e9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.041968 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.042566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.042844 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.043111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.051811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.053212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ecb47-2e24-46a8-b322-cd8fee7d4bee service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.063132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1328/2665] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:59.334831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.336533 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.350006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64a2c-6d04-4505-a056-151ddccbf759 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.355212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.355841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.356122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.356397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] PATH_INFO: `/v3/projects/8ad0a9d5e50f47f4aa414b1da5281981` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.357666 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad0a9d5e50f47f4aa414b1da5281981)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.359443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.405988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad0a9d5e50f47f4aa414b1da5281981', 'request_id': 'req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:59.411408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad0a9d5e50f47f4aa414b1da5281981', 'request_id': 'req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:59.418189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad0a9d5e50f47f4aa414b1da5281981', 'request_id': 'req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:59.430331 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] The token cache is being invalidate because project 8ad0a9d5e50f47f4aa414b1da5281981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:59.430701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:59.432056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7bf5cdee-0faa-4edf-8183-4efde3bd31ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:59.433588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1338/2666] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:59 2022] DELETE /identity/v3/projects/8ad0a9d5e50f47f4aa414b1da5281981 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:59.438801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.439110 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.439383 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.458321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:59.459499 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.517526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1329/2667] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:59.526525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.526818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.527101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.547414 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:59.548645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.557184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1339/2668] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:59.562191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.573027 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eedf7d-ce01-465d-a7b4-c121cdca6b32 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.576700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.577306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.577618 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.577890 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.578533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:59.578821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.580404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.592569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1330/2669] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:59.597311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.607613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62dbf3-0685-4663-bd33-da7cbc3a9be8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.612365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.613454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.614074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.614594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.615738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.617665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.651649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1340/2670] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:59.653276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.664617 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f758-3f9b-4cf0-b1aa-f6ce3a2fcac0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.732648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.733259 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.733571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.733850 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.734477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.736506 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.756468 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1331/2671] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:59.761032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.771440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e290a2-b789-4017-9363-d770f5f9f892 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.776577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.777179 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.777582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.777802 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.778582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.780194 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.791177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1341/2672] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:59.794639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.804524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c88e-5b98-4cf4-856c-a67fa8219c9c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.809385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.810010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.810294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.810568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.811213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.812788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677922de-1ad3-469a-a49b-12c767a5de98 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.823359 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1332/2673] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:59.827390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.838091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b4d9-5914-4b67-86ac-0f83f7122c4e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.843042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.843678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.843958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.844230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] PATH_INFO: `/v3/projects/c3aa2fb218a34fd1b3101a01c4cc8bb2/users/f0c48821801e49f1bf009328d3ffc4be/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.860682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aa2fb218a34fd1b3101a01c4cc8bb2, user_id=f0c48821801e49f1bf009328d3ffc4be, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.863485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.875983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1342/2674] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:59 2022] PUT /identity/v3/projects/c3aa2fb218a34fd1b3101a01c4cc8bb2/users/f0c48821801e49f1bf009328d3ffc4be/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:59.886309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.886596 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.886869 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.914233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] MFA Rules not processed for user `f0c48821801e49f1bf009328d3ffc4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:59.916101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.924028 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:59.983491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1333/2675] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:59.994431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.996131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:00.053270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02779-e68a-4d99-aa47-79a132c55547 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:00.057063 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:00.057697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:00.057979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:00.058250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:00.066601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:00.068298 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa97ff-4ea6-4222-8a0b-3ab0d4dafbd1 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:00.078262 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1343/2676] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:09.980696 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=23 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:10.073972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:10.166593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:10.228535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e47c8e-7f68-4d62-afd5-94a8afdbc1f8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:10.232955 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:10.233544 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:10.233848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:10.234120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] PATH_INFO: `/v3/users/f0c48821801e49f1bf009328d3ffc4be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:10.235214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c48821801e49f1bf009328d3ffc4be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:10.237114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:10.283927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c48821801e49f1bf009328d3ffc4be'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.290810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c48821801e49f1bf009328d3ffc4be'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.291467 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c48821801e49f1bf009328d3ffc4be'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.292075 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c48821801e49f1bf009328d3ffc4be'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.299600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c48821801e49f1bf009328d3ffc4be'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.317078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1334/2677] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:10 2022] DELETE /identity/v3/users/f0c48821801e49f1bf009328d3ffc4be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:10.322537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:10.322957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:10.323200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:10.342117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:10.343321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:10.405076 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1344/2678] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:10.414884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:10.416382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:10.477906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950d012-90ff-4b6e-b181-2cfb53814ed2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:10.481633 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:10.482241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:10.482522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:10.482796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:10.491932 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:10.493809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:10.503514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1335/2679] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:10.781260 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:10.782733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:10.795186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d105e8-a5cb-4a8f-826c-b111b0693d1b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:10.799745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:10.800369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:10.800652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:10.800925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] PATH_INFO: `/v3/projects/c3aa2fb218a34fd1b3101a01c4cc8bb2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:10.802128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3aa2fb218a34fd1b3101a01c4cc8bb2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:10.804030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:10.853670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3aa2fb218a34fd1b3101a01c4cc8bb2', 'request_id': 'req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.859490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3aa2fb218a34fd1b3101a01c4cc8bb2', 'request_id': 'req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.865613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3aa2fb218a34fd1b3101a01c4cc8bb2', 'request_id': 'req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.878519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] The token cache is being invalidate because project c3aa2fb218a34fd1b3101a01c4cc8bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:10.878806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.879416 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-234ea3e6-ad85-4bbf-80f3-dc8318f613e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:10.880877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1345/2680] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:10 2022] DELETE /identity/v3/projects/c3aa2fb218a34fd1b3101a01c4cc8bb2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:13.401191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:13.402647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:13.415288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeed6e-faef-49a7-bc4e-7938e9fa1428 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:13.433583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:13.474366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:13.474999 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:13.475281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:13.475554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] PATH_INFO: `/v3/users/9d6e846cdd994cf5a60308b9ba04f43d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:13.476669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6e846cdd994cf5a60308b9ba04f43d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:13.478649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:13.524678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6e846cdd994cf5a60308b9ba04f43d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:13.531390 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6e846cdd994cf5a60308b9ba04f43d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:13.532041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6e846cdd994cf5a60308b9ba04f43d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:13.532645 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6e846cdd994cf5a60308b9ba04f43d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:13.540335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6e846cdd994cf5a60308b9ba04f43d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:13.557916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1336/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:13 2022] DELETE /identity/v3/users/9d6e846cdd994cf5a60308b9ba04f43d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:19:13.562502 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:13.563017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:13.563137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:13.581613 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:13.582796 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:13.640546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1346/2682] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:13.650429 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:13.651940 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:13.708377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419a3e2-330b-4a0d-8f0b-2a95c6f8343e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:13.712735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:13.713340 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:13.713666 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:13.713935 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:13.722897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:13.724292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:13.734113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1337/2683] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:13.999974 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.001418 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.015979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a943d-569a-4a0f-8841-a2a669dc61b7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.021101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.021976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.022266 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.022546 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] PATH_INFO: `/v3/projects/378218624b564a7baa7b24e5909803fb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.023685 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378218624b564a7baa7b24e5909803fb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.025612 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.047866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:14.074358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378218624b564a7baa7b24e5909803fb', 'request_id': 'req-4e128a41-b577-46e7-a300-21fdd8f39ea7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.079838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378218624b564a7baa7b24e5909803fb', 'request_id': 'req-4e128a41-b577-46e7-a300-21fdd8f39ea7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.086443 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378218624b564a7baa7b24e5909803fb', 'request_id': 'req-4e128a41-b577-46e7-a300-21fdd8f39ea7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.099840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] The token cache is being invalidate because project 378218624b564a7baa7b24e5909803fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:14.100128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.100775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.102569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1347/2684] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:13 2022] DELETE /identity/v3/projects/378218624b564a7baa7b24e5909803fb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:14.106777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.116509 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c29c-14ed-4469-8457-3943ddcbe61d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.158234 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:14.174678 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.175306 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.175586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.175855 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] PATH_INFO: `/v3/users/d1a5ecbe669a40e0a5f50b541815430c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.177031 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a5ecbe669a40e0a5f50b541815430c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.178919 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.226815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a5ecbe669a40e0a5f50b541815430c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.233691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a5ecbe669a40e0a5f50b541815430c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.234357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a5ecbe669a40e0a5f50b541815430c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.234971 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a5ecbe669a40e0a5f50b541815430c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.242257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6f53dd32-4791-4ed2-b610-709729b71414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a5ecbe669a40e0a5f50b541815430c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.260386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1338/2685] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:14 2022] DELETE /identity/v3/users/d1a5ecbe669a40e0a5f50b541815430c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:14.520665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.522102 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.535521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a41-b577-46e7-a300-21fdd8f39ea7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.594326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.595043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.595238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.595513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] PATH_INFO: `/v3/projects/f737d2509faf4fed807dd4fd6be96ded` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.596616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f737d2509faf4fed807dd4fd6be96ded)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.598577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.643809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f737d2509faf4fed807dd4fd6be96ded', 'request_id': 'req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.650419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f737d2509faf4fed807dd4fd6be96ded', 'request_id': 'req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.656559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f737d2509faf4fed807dd4fd6be96ded', 'request_id': 'req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.669120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] The token cache is being invalidate because project f737d2509faf4fed807dd4fd6be96ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:14.669429 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.670074 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0632b9cc-c7d1-4bf3-a714-b2fd339ec51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.671525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1348/2686] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:14 2022] DELETE /identity/v3/projects/f737d2509faf4fed807dd4fd6be96ded => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:14.676380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.676875 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.676978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.696207 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:14.697746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.760780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1339/2687] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:14.769632 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.769918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.770193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.790722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:14.791936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.799840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1349/2688] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:14.804232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.813998 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8968be-0fa0-467b-b362-861fe859a640 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.818609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.819209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.819522 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.819797 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.820470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:14.820976 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.822788 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.835669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1340/2689] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:19:14.840551 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.850323 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065774b-55b6-415c-be91-7ada87b68f64 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.855569 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.856295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.856591 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.856897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.857637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.859590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.886127 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1350/2690] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:14.890318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.901145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f668-1000-4065-8dd2-6956fbd04156 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.946501 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:14.958125 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.958724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.959000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.959268 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.959880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.962915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.983894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1341/2691] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:14 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:14.987992 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.998161 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dada7b-b1b1-42f3-8802-ffd48228047a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.002652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.003235 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.003516 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.003783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.004421 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.006039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.008610 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:15.017804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1351/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:15.021464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.031756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249cd3-c457-4510-8182-2b2310dd7efa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.036316 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.036900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.037179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.037449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.038108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.040660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e098e-1ebf-4d6e-8d45-b404bf5316fb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.051188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1342/2693] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:15.055814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.065712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a07b-be45-4e3c-ba20-4c7e7d82a09b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.070225 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.071133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.071423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.071699 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] PATH_INFO: `/v3/projects/10682ea94ae84a219f89f0dedfcc9d5d/users/4f2d3bfc8d184b11af9fe0317534f860/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.085994 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10682ea94ae84a219f89f0dedfcc9d5d, user_id=4f2d3bfc8d184b11af9fe0317534f860, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.088704 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.102824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1352/2694] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:15 2022] PUT /identity/v3/projects/10682ea94ae84a219f89f0dedfcc9d5d/users/4f2d3bfc8d184b11af9fe0317534f860/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:15.113151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.113436 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.113737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.141480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] MFA Rules not processed for user `4f2d3bfc8d184b11af9fe0317534f860`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:15.142690 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:15.206951 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1343/2695] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:15.211822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.272506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a603b-6ee8-47dd-9f14-f446615418f4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.277138 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.277769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.278052 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.278328 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.278958 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.280854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.307522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1353/2696] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:15 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:15.311621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.322090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49999a4c-0635-43e5-8c2b-c17331a8aa4a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.377992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.378598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.378881 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.379156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.379780 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.381710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.403532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1344/2697] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:15 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:15.407520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.418603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05e58-eadc-4b30-8e35-0be6eab5bd52 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.423254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.423849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.424160 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.424435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.425079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.426708 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.437407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1354/2698] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:15.441607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.451828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917065-b770-4a1c-b498-22541729bd9e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.456381 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.457021 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.457301 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.457607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] PATH_INFO: `/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4/users/e55bcae9fd9840eeab873b85a0a42ddc/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.472914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66fbd35f6834080ba9cb2705f61cbe4, user_id=e55bcae9fd9840eeab873b85a0a42ddc, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.475565 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.489074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1345/2699] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:15 2022] PUT /identity/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4/users/e55bcae9fd9840eeab873b85a0a42ddc/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:19:15.493130 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.503166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f4cfe-a68c-4a18-a202-7fc17929b7e9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.559648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.560193 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.560531 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.560856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.561500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.563135 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ce3c-bfd0-4539-813e-4f4b22e9da81 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.573189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1355/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:15.577443 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.588616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07381e-0778-46d0-835b-1b19506b6842 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.593067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.593742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.594023 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.594295 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] PATH_INFO: `/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4/users/e55bcae9fd9840eeab873b85a0a42ddc/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.596174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66fbd35f6834080ba9cb2705f61cbe4, user_id=e55bcae9fd9840eeab873b85a0a42ddc, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.598810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.609686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1346/2701] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:15 2022] PUT /identity/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4/users/e55bcae9fd9840eeab873b85a0a42ddc/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:15.620602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915017-9546-4233-a642-3432461120ce None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.621116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915017-9546-4233-a642-3432461120ce None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.621232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915017-9546-4233-a642-3432461120ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.648051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-96915017-9546-4233-a642-3432461120ce None None] MFA Rules not processed for user `e55bcae9fd9840eeab873b85a0a42ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:15.649886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-96915017-9546-4233-a642-3432461120ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:15.681679 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:15.718141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1356/2702] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:15.731364 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.733152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:15.748631 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:15.794842 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94b67-2de3-4374-bca4-8f2183163289 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.798640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.799267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.799550 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.799826 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.808972 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.810514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.819907 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1347/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:16.129978 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96915017-9546-4233-a642-3432461120ce None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.139166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96915017-9546-4233-a642-3432461120ce None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.143781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55bcae9fd9840eeab873b85a0a42ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66fbd35f6834080ba9cb2705f61cbe4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.144409 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.144696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.144981 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.145663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:16.145973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:16.147663 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:16.159818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1357/2704] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:16.163921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.173481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83703350-c834-46e4-9607-156e209b3046 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.178095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55bcae9fd9840eeab873b85a0a42ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66fbd35f6834080ba9cb2705f61cbe4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.178693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.178975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.179250 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.179910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:16.182024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:16.212469 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1348/2705] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:16 2022] POST /identity/v3/projects => generated 354 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:16.216667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.226705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180924-bc85-4f4d-9d9e-55909418c2a8 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.284452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55bcae9fd9840eeab873b85a0a42ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66fbd35f6834080ba9cb2705f61cbe4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.285048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.285329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.285637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.286265 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:16.286567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:16.288304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:16.300202 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1358/2706] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:16.337734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.347578 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1197c-aa76-419a-aa91-ca99c1f6cb38 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.352902 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55bcae9fd9840eeab873b85a0a42ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66fbd35f6834080ba9cb2705f61cbe4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.353577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.353863 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.354136 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] PATH_INFO: `/v3/projects/fe384a63bf244807acef24694ec41cae` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.355263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe384a63bf244807acef24694ec41cae)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:16.357132 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:16.402536 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe384a63bf244807acef24694ec41cae', 'request_id': 'req-73906932-3105-434f-aef2-924aa1ab1ffe'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.408096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe384a63bf244807acef24694ec41cae', 'request_id': 'req-73906932-3105-434f-aef2-924aa1ab1ffe'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.421654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe384a63bf244807acef24694ec41cae', 'request_id': 'req-73906932-3105-434f-aef2-924aa1ab1ffe'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.434232 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] The token cache is being invalidate because project fe384a63bf244807acef24694ec41cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:16.434519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.435145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-73906932-3105-434f-aef2-924aa1ab1ffe tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.436612 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1349/2707] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:16 2022] DELETE /identity/v3/projects/fe384a63bf244807acef24694ec41cae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:16.630976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.632710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:16.697387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5989b0-b959-474d-af2d-86472b3edac3 tempest-VolumeQuotaClassesTest-278825890 tempest-VolumeQuotaClassesTest-278825890-project-admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.746286 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:16.752401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.753065 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.753340 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.753644 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] PATH_INFO: `/v3/users/4f2d3bfc8d184b11af9fe0317534f860` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.754756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2d3bfc8d184b11af9fe0317534f860)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:16.756676 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:16.801601 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2d3bfc8d184b11af9fe0317534f860'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.808607 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2d3bfc8d184b11af9fe0317534f860'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.809280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2d3bfc8d184b11af9fe0317534f860'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.817682 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2d3bfc8d184b11af9fe0317534f860'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.832758 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2d3bfc8d184b11af9fe0317534f860'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:16.839538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1359/2708] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:16 2022] DELETE /identity/v3/users/4f2d3bfc8d184b11af9fe0317534f860 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:16.843987 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.844452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.844548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:16.863745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:16.864882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:16.922380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1350/2709] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:16.932557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:16.933995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:16.990212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598aac-42b5-45a6-9067-d9c37a2a044a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:16.994410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:16.995008 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:16.995287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:16.995558 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:17.004342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:17.005795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:17.015608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1360/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:17.283926 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:17.285427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:17.298377 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df7985-ea90-4414-ae6d-099c70a4a4d6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:17.303091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:17.303808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:17.304153 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:17.304520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] PATH_INFO: `/v3/projects/10682ea94ae84a219f89f0dedfcc9d5d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:17.306660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10682ea94ae84a219f89f0dedfcc9d5d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:17.308974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:17.320077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:17.357171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10682ea94ae84a219f89f0dedfcc9d5d', 'request_id': 'req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.363042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10682ea94ae84a219f89f0dedfcc9d5d', 'request_id': 'req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.369816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10682ea94ae84a219f89f0dedfcc9d5d', 'request_id': 'req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.381898 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] The token cache is being invalidate because project 10682ea94ae84a219f89f0dedfcc9d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:17.382187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.382824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.384471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1351/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:17 2022] DELETE /identity/v3/projects/10682ea94ae84a219f89f0dedfcc9d5d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:17.388474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:17.398050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c23e2-284c-4587-a365-7652005b3dba service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:17.453804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:17.454355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:17.454635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:17.454909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] PATH_INFO: `/v3/users/e55bcae9fd9840eeab873b85a0a42ddc` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:17.456042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55bcae9fd9840eeab873b85a0a42ddc)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:17.458108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:17.480166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:17.505080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55bcae9fd9840eeab873b85a0a42ddc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.512155 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55bcae9fd9840eeab873b85a0a42ddc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.512799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55bcae9fd9840eeab873b85a0a42ddc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.520055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55bcae9fd9840eeab873b85a0a42ddc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.532345 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e08ea36-98af-40ed-944c-372dd56f580c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55bcae9fd9840eeab873b85a0a42ddc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.538025 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1361/2712] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:17 2022] DELETE /identity/v3/users/e55bcae9fd9840eeab873b85a0a42ddc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:17.810433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:17.811846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:17.829730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b3b8-ff64-4acc-8ea8-688b9ab0aad6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:17.889534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:17.890203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:17.890439 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:17.890710 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] PATH_INFO: `/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:17.891830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66fbd35f6834080ba9cb2705f61cbe4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:17.893764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:17.938424 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66fbd35f6834080ba9cb2705f61cbe4', 'request_id': 'req-643c1c8d-916c-47f5-9656-fa250ce3f736'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.943806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66fbd35f6834080ba9cb2705f61cbe4', 'request_id': 'req-643c1c8d-916c-47f5-9656-fa250ce3f736'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.950503 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66fbd35f6834080ba9cb2705f61cbe4', 'request_id': 'req-643c1c8d-916c-47f5-9656-fa250ce3f736'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.962637 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] The token cache is being invalidate because project b66fbd35f6834080ba9cb2705f61cbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:17.962865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.963480 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-643c1c8d-916c-47f5-9656-fa250ce3f736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:17.964930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1352/2713] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:17 2022] DELETE /identity/v3/projects/b66fbd35f6834080ba9cb2705f61cbe4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:17.969815 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:17.970271 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:17.970365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:17.989667 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:17.990866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:18.049788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1362/2714] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:18.058203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.058534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.058853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.078911 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:18.080107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:18.088308 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1353/2715] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:18.092501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.106246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae63af-98c6-45df-a583-59115ca87a14 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.110997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.111656 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.111935 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.112208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.112848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:18.113177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.114798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.127170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1363/2716] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:18.131733 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.140950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c276c0-b19c-4b2f-a8be-e1b9dac26243 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.145603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.146201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.146479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.146751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.147368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.149276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.170870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:18.182032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1354/2717] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:18.183431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.193620 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96e086-ad28-432e-8c82-c015be1b3df7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.249976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.250507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.250783 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.251053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.251681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.253606 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.275033 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1364/2718] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:18.279264 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.289597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5749-6b29-46a9-85c4-20a2eb527252 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.294224 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.294815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.295096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.295371 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.296006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.297622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.307421 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1355/2719] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:18.311222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.321535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc3434-af2b-4018-ab7d-a982151732a2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.326079 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.326665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.326945 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.327220 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.327853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.329428 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a8f2-af09-4829-b87e-20c0039d55a8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.340837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1365/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:18.344876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.355175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81262ab-6e50-4865-acc0-66182bf706f8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.359854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.360566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.361007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.361230 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] PATH_INFO: `/v3/projects/5d947152d65d46e59f9471fd4d0ed96f/users/612dd54ea7364a9085fb025bacbd60b1/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.375942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d947152d65d46e59f9471fd4d0ed96f, user_id=612dd54ea7364a9085fb025bacbd60b1, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.378611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.391482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1356/2721] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:18 2022] PUT /identity/v3/projects/5d947152d65d46e59f9471fd4d0ed96f/users/612dd54ea7364a9085fb025bacbd60b1/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:18.402280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.402568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.402841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.410846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:18.432031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] MFA Rules not processed for user `612dd54ea7364a9085fb025bacbd60b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:18.433280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:18.497148 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1366/2722] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:18.501688 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.564227 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04874e0c-0877-46d6-ab9d-e8e4ec39700e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.568886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.569486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.569794 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.570086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.571477 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.573357 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.599035 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1357/2723] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:18.603211 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.613664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6327e0-523e-4d1f-a87f-122d8b9b94e5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.669291 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.670146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.670146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.670561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.671084 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.672971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.694165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1367/2724] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:18.698831 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.708931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44b0d-0dfe-4e66-8d81-cd36a740b0ff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.714152 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.714755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.715038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.715312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.715954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.717569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.728051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1358/2725] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:18.731970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.741767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d029c-0e8e-43b4-869b-4ca13b459af1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.746889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.747521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.747798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.748070 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] PATH_INFO: `/v3/projects/9e68877825404500b6824b0c43f2e413/users/014633cc15d54ddc8dfb4d59ae5488c5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.762892 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e68877825404500b6824b0c43f2e413, user_id=014633cc15d54ddc8dfb4d59ae5488c5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.765456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.778745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1368/2726] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:18 2022] PUT /identity/v3/projects/9e68877825404500b6824b0c43f2e413/users/014633cc15d54ddc8dfb4d59ae5488c5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:18.782613 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.793067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f984d-de64-4169-bd5c-c16d3a453d97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.848560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.849173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.849447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.849778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.850418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.852527 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db598-f396-41fa-a896-06094b5d687a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.862606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1359/2727] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:18.866724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:18.877654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcdd54-4878-45fe-aee7-aff7fcf4b456 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:18.882295 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:18.882976 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.883256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.883528 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] PATH_INFO: `/v3/projects/9e68877825404500b6824b0c43f2e413/users/014633cc15d54ddc8dfb4d59ae5488c5/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.885399 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e68877825404500b6824b0c43f2e413, user_id=014633cc15d54ddc8dfb4d59ae5488c5, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:18.888047 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:18.898320 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1369/2728] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:18 2022] PUT /identity/v3/projects/9e68877825404500b6824b0c43f2e413/users/014633cc15d54ddc8dfb4d59ae5488c5/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:18.963973 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:18.964749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:18.964749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:18.992222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] MFA Rules not processed for user `014633cc15d54ddc8dfb4d59ae5488c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:18.994246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:19.017337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:19.062226 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1360/2729] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:19.072898 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:19.074672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:19.127975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:19.134640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4403fd9-624e-49c7-b973-efbd4e74f1e3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:19.138473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:19.139116 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:19.139424 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:19.139705 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:19.149237 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:19.150711 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:19.160165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1370/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:19.206752 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:19.208140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:19.220906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93437-60df-486b-a1a3-0d90af3e4b74 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:19.224535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:19.225131 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:19.225412 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:19.225723 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:19.281562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:19.282923 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954613b-74d8-4f1d-bef0-1afd58378587 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:19.292216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1361/2731] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:22.589327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:22.650843 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817ca6-9931-46ef-b2fb-5a974b630b33 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:22.655379 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:22.655999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:22.656276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:22.656547 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] PATH_INFO: `/v3/users/612dd54ea7364a9085fb025bacbd60b1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:22.657670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612dd54ea7364a9085fb025bacbd60b1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:22.659576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:22.705717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612dd54ea7364a9085fb025bacbd60b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:22.713410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612dd54ea7364a9085fb025bacbd60b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:22.714099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612dd54ea7364a9085fb025bacbd60b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:22.722506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612dd54ea7364a9085fb025bacbd60b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:22.734869 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612dd54ea7364a9085fb025bacbd60b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:22.740756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1371/2732] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:22 2022] DELETE /identity/v3/users/612dd54ea7364a9085fb025bacbd60b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:22.745313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:22.745857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:22.745958 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:22.765246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:22.766559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:22.824905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1362/2733] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:22.834565 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:22.837203 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:22.895013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33438-853d-45b4-8789-690370cd8957 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:22.899540 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:22.900156 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:22.900431 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:22.900700 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:22.909444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:22.910894 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:22.920513 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1372/2734] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:23.184193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:23.185744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:23.200179 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c1253-27fe-45d9-8e09-f96a606893d0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:23.204841 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:23.205479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:23.205795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:23.206193 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] PATH_INFO: `/v3/projects/5d947152d65d46e59f9471fd4d0ed96f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:23.207329 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d947152d65d46e59f9471fd4d0ed96f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:23.209303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:23.257347 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d947152d65d46e59f9471fd4d0ed96f', 'request_id': 'req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.262167 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:23.264540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d947152d65d46e59f9471fd4d0ed96f', 'request_id': 'req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.271740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d947152d65d46e59f9471fd4d0ed96f', 'request_id': 'req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.284155 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] The token cache is being invalidate because project 5d947152d65d46e59f9471fd4d0ed96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:23.284440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.285044 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.286542 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1363/2735] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:23 2022] DELETE /identity/v3/projects/5d947152d65d46e59f9471fd4d0ed96f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:23.291510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:23.301002 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04cda3-8364-4ea6-bd01-441b7f69af6b service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:23.309465 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:23.360186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:23.360816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:23.361099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:23.361372 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] PATH_INFO: `/v3/users/014633cc15d54ddc8dfb4d59ae5488c5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:23.362523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014633cc15d54ddc8dfb4d59ae5488c5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:23.364438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:23.408042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014633cc15d54ddc8dfb4d59ae5488c5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.415927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014633cc15d54ddc8dfb4d59ae5488c5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.416571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014633cc15d54ddc8dfb4d59ae5488c5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.423903 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014633cc15d54ddc8dfb4d59ae5488c5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.436990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-519db5fc-2d23-4a3d-801e-e46ce0d48cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014633cc15d54ddc8dfb4d59ae5488c5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.442745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1373/2736] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:23 2022] DELETE /identity/v3/users/014633cc15d54ddc8dfb4d59ae5488c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:23.723398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:23.725043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:23.739113 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2f8d-aac8-4ebd-ac70-249253e9f9dc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:23.809087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:23.809725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:23.809947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:23.810162 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] PATH_INFO: `/v3/projects/9e68877825404500b6824b0c43f2e413` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:23.811287 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e68877825404500b6824b0c43f2e413)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:23.813158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:23.864870 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e68877825404500b6824b0c43f2e413', 'request_id': 'req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.871974 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e68877825404500b6824b0c43f2e413', 'request_id': 'req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.878351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e68877825404500b6824b0c43f2e413', 'request_id': 'req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.891511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] The token cache is being invalidate because project 9e68877825404500b6824b0c43f2e413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:23.891798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.892410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-16799ec5-a94b-462a-a10d-5e7b8f7b89e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:23.894134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1364/2737] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:23 2022] DELETE /identity/v3/projects/9e68877825404500b6824b0c43f2e413 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:23.899485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:23.899985 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:23.900230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:23.921077 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:23.922400 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:23.986256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1374/2738] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:23.994243 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:23.994535 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:23.994812 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.015115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:24.016322 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:24.024903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1365/2739] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:24.029056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.038575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590b22f-bba1-4c88-8912-33ba9b0ba2c8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.043307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.043899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.044184 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.044459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.045099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:24.045407 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.047028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.058733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1375/2740] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:24.062928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.072871 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8ff0-39b4-4171-887e-2a2ea5f77737 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.077577 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.078174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.078455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.078727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.079391 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.081291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.115257 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1366/2741] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:24.120128 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.130170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96855420-5668-4c1d-9dbc-a3a9352e0d8e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.142103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:24.188035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.188641 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.188921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.189191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.189839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.191778 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.212695 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1376/2742] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:24.216900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.227614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9b691-9b24-419d-b0a1-30a503ed0667 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.232210 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.232801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.233080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.233348 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.234032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.235604 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.245872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1367/2743] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:24.249804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.259550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7861a-59c8-4c27-b1b6-15f1b7eed6bd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.264190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.264781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.265769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.266043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.266687 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.268281 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754b4e-e9b5-4785-9fbe-b044e18f6e7e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.278715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1377/2744] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:24.282983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.293491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb34b5d-3048-4135-acc4-420a37271d03 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.298140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.298785 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.299067 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.299343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] PATH_INFO: `/v3/projects/80076530559047ee905f16ec11d28a0f/users/346b7565a51a4a1fa5eeb68fb62eba02/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.314293 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80076530559047ee905f16ec11d28a0f, user_id=346b7565a51a4a1fa5eeb68fb62eba02, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.316906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.329669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1368/2745] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:24 2022] PUT /identity/v3/projects/80076530559047ee905f16ec11d28a0f/users/346b7565a51a4a1fa5eeb68fb62eba02/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:24.340274 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.340589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.340891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.369819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] MFA Rules not processed for user `346b7565a51a4a1fa5eeb68fb62eba02`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:24.371023 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:24.435521 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1378/2746] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:24.440121 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.450313 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:24.503218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7558-4849-4929-ba41-7a709d5baa03 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.507886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.508481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.508758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.509025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.509686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.511598 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.538520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1369/2747] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:24.543224 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.553886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef920b56-dc8d-408a-aad0-dd74937f6026 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.610050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.610651 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.610930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.611201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.611814 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.613893 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.634995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1379/2748] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:24.639006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.650094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88922-4d80-445c-84ad-29c52838b858 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.654725 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.655318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.655614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.655868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.656508 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.658135 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.669346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1370/2749] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:24.673396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.683387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a763a-2b63-47bc-bae4-5ef1f1996799 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.688026 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.688618 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.688902 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.689181 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.689864 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.691459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7627832-888d-449a-a4c3-6da594562052 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.701223 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1380/2750] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:24.705100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.715665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679dea0-ebad-47be-8748-031e62b75759 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.720420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.721064 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.721344 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.721646 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] PATH_INFO: `/v3/projects/bb73dfec17a34cb9b6ad96265bcfd95a/users/f2c5f370b3c94ef49728a979e60dc620/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.736534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb73dfec17a34cb9b6ad96265bcfd95a, user_id=f2c5f370b3c94ef49728a979e60dc620, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.739204 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.751490 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1371/2751] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:24 2022] PUT /identity/v3/projects/bb73dfec17a34cb9b6ad96265bcfd95a/users/f2c5f370b3c94ef49728a979e60dc620/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:24.763216 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.763539 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.763817 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.771853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:24.793927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] MFA Rules not processed for user `f2c5f370b3c94ef49728a979e60dc620`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:24.795146 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:24.858455 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1381/2752] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:24.864724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.924140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6c56-3434-4c18-b827-44d3e8b9e9c4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:24.928765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:24.929487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:24.929796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:24.930111 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:24.930693 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:24.932569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:24.958707 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1372/2753] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:24.963707 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:24.974624 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143912b0-a363-4cd2-bc2f-4326e043fe2b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.032118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.032724 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.033003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.033273 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.033944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.035854 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.057484 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1382/2754] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:24 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:25.061450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:25.072485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1da31-d4c7-4726-aa91-b38ba1be0599 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.077120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.077759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.078664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.078947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.079623 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.081214 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.092852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1373/2755] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:25.097058 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:25.111803 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad512be-3f3b-4ad5-ac4a-166398fcfb1d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.116598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.117918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.118212 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.118486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] PATH_INFO: `/v3/projects/6bece7516e7b4c4ab702458a4ebc8708/users/f73585adf54a4f9f94109d18dc7f4bbe/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.133798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bece7516e7b4c4ab702458a4ebc8708, user_id=f73585adf54a4f9f94109d18dc7f4bbe, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.136457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.150756 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1383/2756] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:25 2022] PUT /identity/v3/projects/6bece7516e7b4c4ab702458a4ebc8708/users/f73585adf54a4f9f94109d18dc7f4bbe/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:25.154721 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:25.165462 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f23d-875a-4948-95e9-1a523a3bbcc5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.194990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:25.222751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.223362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.223641 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.223914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.224548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.226173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e19a83-83fe-48ca-88ec-465e3a923581 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.236447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1374/2757] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:25.240554 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:25.251005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cca39-4d2d-4577-b32f-e14458f0be11 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.255595 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.256238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.256518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.256792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] PATH_INFO: `/v3/projects/6bece7516e7b4c4ab702458a4ebc8708/users/f73585adf54a4f9f94109d18dc7f4bbe/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.258946 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bece7516e7b4c4ab702458a4ebc8708, user_id=f73585adf54a4f9f94109d18dc7f4bbe, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.261614 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.271561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1384/2758] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:25 2022] PUT /identity/v3/projects/6bece7516e7b4c4ab702458a4ebc8708/users/f73585adf54a4f9f94109d18dc7f4bbe/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:25.282240 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.282533 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.282811 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.312792 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] MFA Rules not processed for user `f73585adf54a4f9f94109d18dc7f4bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:25.313964 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:25.381995 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1375/2759] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:25.393574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:25.395285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:25.449057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:25.455089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599401-f71c-45f0-859c-b4abbe4db8cf admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:25.459132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:25.459736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:25.460030 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:25.460561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:25.516604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:25.518056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:25.527256 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1385/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:27.089006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:27.090474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:27.103762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb2ca4-18f3-41bd-86d2-dfb25e5448d7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:27.107600 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:27.108156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:27.108437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:27.108708 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:27.167839 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:27.169485 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6509c5-d6de-4ea6-91fc-391c8576f4db service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:27.178699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1376/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:27.770258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:27.779765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4afd-6843-4620-8f99-33bfc75ca4ed service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:27.783602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:27.784239 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:27.784538 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:27.784797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:27.794777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:27.796197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:27.806447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1386/2762] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:30.797540 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fb11-3f29-416c-831f-25fa539b8170 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.798146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fb11-3f29-416c-831f-25fa539b8170 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.798146 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239fb11-3f29-416c-831f-25fa539b8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.817548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9239fb11-3f29-416c-831f-25fa539b8170 None None] MFA Rules not processed for user `9c68e1e3809a472eaf5db0e573a2578c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:30.818754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9239fb11-3f29-416c-831f-25fa539b8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:30.872526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:30.881070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1377/2763] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:31.734764 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.813359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c75a-57d7-4c4e-87c5-cf47316b1e5a service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.819390 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.820637 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.820799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.821215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] PATH_INFO: `/v3/users/346b7565a51a4a1fa5eeb68fb62eba02` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.822608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346b7565a51a4a1fa5eeb68fb62eba02)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.824588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.882118 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346b7565a51a4a1fa5eeb68fb62eba02'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:31.890205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346b7565a51a4a1fa5eeb68fb62eba02'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:31.890866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346b7565a51a4a1fa5eeb68fb62eba02'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:31.898654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346b7565a51a4a1fa5eeb68fb62eba02'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:31.910672 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346b7565a51a4a1fa5eeb68fb62eba02'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:31.916567 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1387/2764] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:31 2022] DELETE /identity/v3/users/346b7565a51a4a1fa5eeb68fb62eba02 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:31.921100 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.921726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.921726 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.941848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:31.943395 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:32.009130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1378/2765] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:32.020122 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:32.022081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:32.033458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:32.085564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d992-523e-490f-9da7-9d9838509381 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:32.089883 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:32.090497 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:32.090810 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:32.091055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:32.101196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:32.102917 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:32.113231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1388/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:32.406178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:32.407981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:32.421463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77b17-b000-4dfa-83c4-eb5c1e97bd21 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:32.426382 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:32.427049 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:32.427327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:32.427597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] PATH_INFO: `/v3/projects/80076530559047ee905f16ec11d28a0f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:32.429150 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80076530559047ee905f16ec11d28a0f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:32.432363 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:32.482471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80076530559047ee905f16ec11d28a0f', 'request_id': 'req-e2058b81-a33d-4265-9440-b36969872f72'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.488140 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80076530559047ee905f16ec11d28a0f', 'request_id': 'req-e2058b81-a33d-4265-9440-b36969872f72'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.495261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80076530559047ee905f16ec11d28a0f', 'request_id': 'req-e2058b81-a33d-4265-9440-b36969872f72'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.508358 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] The token cache is being invalidate because project 80076530559047ee905f16ec11d28a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:32.508730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.509426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.510944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1379/2767] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:32 2022] DELETE /identity/v3/projects/80076530559047ee905f16ec11d28a0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:32.515005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:32.524955 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a7f1-0214-40cf-87e5-9c4b7c4e87b6 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:32.580346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:32.581109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:32.581395 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:32.581701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] PATH_INFO: `/v3/users/f2c5f370b3c94ef49728a979e60dc620` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:32.582818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c5f370b3c94ef49728a979e60dc620)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:32.584733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:32.631518 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c5f370b3c94ef49728a979e60dc620'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.638720 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c5f370b3c94ef49728a979e60dc620'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.639386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c5f370b3c94ef49728a979e60dc620'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.646561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c5f370b3c94ef49728a979e60dc620'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.658886 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c5f370b3c94ef49728a979e60dc620'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:32.665560 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1389/2768] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:32 2022] DELETE /identity/v3/users/f2c5f370b3c94ef49728a979e60dc620 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:33.079606 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:33.081244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:33.095679 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2058b81-a33d-4265-9440-b36969872f72 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:33.155437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:33.156083 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.156361 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.156635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] PATH_INFO: `/v3/projects/bb73dfec17a34cb9b6ad96265bcfd95a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.157849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb73dfec17a34cb9b6ad96265bcfd95a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:33.159806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:33.186303 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:33.211372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb73dfec17a34cb9b6ad96265bcfd95a', 'request_id': 'req-f3303d95-d421-4af8-8459-e3c0abb95949'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.217324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb73dfec17a34cb9b6ad96265bcfd95a', 'request_id': 'req-f3303d95-d421-4af8-8459-e3c0abb95949'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.223673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb73dfec17a34cb9b6ad96265bcfd95a', 'request_id': 'req-f3303d95-d421-4af8-8459-e3c0abb95949'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.238045 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] The token cache is being invalidate because project bb73dfec17a34cb9b6ad96265bcfd95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:33.238337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.239055 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.240657 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1380/2769] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:33 2022] DELETE /identity/v3/projects/bb73dfec17a34cb9b6ad96265bcfd95a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:33.245432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:33.246900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:33.260241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2006-93ba-48f0-b972-63d165f4b6a1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:33.287657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:33.320703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:33.321342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.321653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.321927 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] PATH_INFO: `/v3/users/f73585adf54a4f9f94109d18dc7f4bbe` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.323113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73585adf54a4f9f94109d18dc7f4bbe)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:33.325040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:33.374972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73585adf54a4f9f94109d18dc7f4bbe'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.381997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73585adf54a4f9f94109d18dc7f4bbe'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.382903 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73585adf54a4f9f94109d18dc7f4bbe'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.390454 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73585adf54a4f9f94109d18dc7f4bbe'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.403960 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52b619be-f427-43d3-b0d6-c9384b72a895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73585adf54a4f9f94109d18dc7f4bbe'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.410253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1390/2770] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:33 2022] DELETE /identity/v3/users/f73585adf54a4f9f94109d18dc7f4bbe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:33.848386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:33.849946 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:33.867486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303d95-d421-4af8-8459-e3c0abb95949 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:33.951665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:33.952319 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.952605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.952885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] PATH_INFO: `/v3/projects/6bece7516e7b4c4ab702458a4ebc8708` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.954119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bece7516e7b4c4ab702458a4ebc8708)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:33.956215 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.021729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bece7516e7b4c4ab702458a4ebc8708', 'request_id': 'req-e1fb0b52-a092-478f-8615-dd75bf2397ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.029073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bece7516e7b4c4ab702458a4ebc8708', 'request_id': 'req-e1fb0b52-a092-478f-8615-dd75bf2397ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.035857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bece7516e7b4c4ab702458a4ebc8708', 'request_id': 'req-e1fb0b52-a092-478f-8615-dd75bf2397ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.050463 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] The token cache is being invalidate because project 6bece7516e7b4c4ab702458a4ebc8708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:34.050695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.051278 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1fb0b52-a092-478f-8615-dd75bf2397ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.052897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1381/2771] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:33 2022] DELETE /identity/v3/projects/6bece7516e7b4c4ab702458a4ebc8708 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:34.058967 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.059326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.059625 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.081261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:34.082522 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:34.153073 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1391/2772] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:34.166360 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.166895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.167374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.194587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:34.196640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:34.207292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1382/2773] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:34.213589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.224200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc009c-c17a-4209-9cd8-ffaea177d7e5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.230446 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.231198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.231485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.231755 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.232401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:34.232757 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.234436 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.246900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1392/2774] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:34.251714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.261489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621428c-09c8-4a68-8444-26b9d958de2f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.266569 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.267201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.267512 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.267789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.268444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.270386 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.300661 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1383/2775] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:34.304838 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.316314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65b2f-ca50-44ec-9a8a-d9c05ea7384e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.359427 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:34.389909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.390904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.391210 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.391511 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.392329 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.395121 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.429689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1393/2776] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:34.430892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.442546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeea83-a066-437b-823a-d0ccce6d4713 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.448292 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.448897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.449175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.449444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.450124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.451714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.464095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1384/2777] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:34.468344 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.478840 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f028e7-502e-41dc-9f14-c87950ad87f0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.483470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.484094 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.484370 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.484638 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.485275 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.486890 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe6a3f-d436-4ec0-8639-af8ce8f4e604 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.497806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1394/2778] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:34.502261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.507981 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:34.515315 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2ee5b-ece6-4c70-b770-2dfcce217a45 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.521593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.522260 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.522539 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.523189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] PATH_INFO: `/v3/projects/9155b851878f4cb0a8b1062a9a581af7/users/cbea4bfb8ca24b65b610e53060829384/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.539298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9155b851878f4cb0a8b1062a9a581af7, user_id=cbea4bfb8ca24b65b610e53060829384, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.542254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.556799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1385/2779] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:34 2022] PUT /identity/v3/projects/9155b851878f4cb0a8b1062a9a581af7/users/cbea4bfb8ca24b65b610e53060829384/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:34.567742 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.568101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.568438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.597577 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] MFA Rules not processed for user `cbea4bfb8ca24b65b610e53060829384`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:34.598776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:34.664844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1395/2780] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:34.675965 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.677779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:34.783856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e958-098a-4213-9581-c2cea143ba57 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.787538 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.788147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.789534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.789744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.798223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.799648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64383f12-adc9-43c4-8952-fc716f6dcee2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.809339 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1386/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:34.835530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.902645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6e0ef-347e-4432-8251-7e60ff2f4435 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.907269 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.907908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.908191 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.908466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] PATH_INFO: `/v3/users/cbea4bfb8ca24b65b610e53060829384` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.909769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbea4bfb8ca24b65b610e53060829384)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.911787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.958258 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:34.960257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbea4bfb8ca24b65b610e53060829384'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.969217 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbea4bfb8ca24b65b610e53060829384'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.970039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbea4bfb8ca24b65b610e53060829384'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.977075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbea4bfb8ca24b65b610e53060829384'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.989254 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbea4bfb8ca24b65b610e53060829384'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.996238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1396/2782] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:34 2022] DELETE /identity/v3/users/cbea4bfb8ca24b65b610e53060829384 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:35.000747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.001039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.001334 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.021942 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:35.023195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.084670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1387/2783] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:35.094747 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.096324 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.155041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bbb9c-2ffe-442b-b458-ff76291dd0ed admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.158915 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.159608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.159991 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.160315 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.170913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.172350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0747-9dff-4450-8056-009c4e6271c2 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.182536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1397/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:35.501362 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.502829 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.515745 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbb68-1cb9-4be1-a881-aae9ecd65402 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.520338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.520969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.521248 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.521534 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] PATH_INFO: `/v3/projects/9155b851878f4cb0a8b1062a9a581af7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.523327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9155b851878f4cb0a8b1062a9a581af7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.525478 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.572743 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9155b851878f4cb0a8b1062a9a581af7', 'request_id': 'req-e3ed50c8-27d5-4137-870e-8e34e94166e5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.578830 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9155b851878f4cb0a8b1062a9a581af7', 'request_id': 'req-e3ed50c8-27d5-4137-870e-8e34e94166e5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.586004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9155b851878f4cb0a8b1062a9a581af7', 'request_id': 'req-e3ed50c8-27d5-4137-870e-8e34e94166e5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.598101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] The token cache is being invalidate because project 9155b851878f4cb0a8b1062a9a581af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:35.598393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.599032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e3ed50c8-27d5-4137-870e-8e34e94166e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.600494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1388/2785] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:35 2022] DELETE /identity/v3/projects/9155b851878f4cb0a8b1062a9a581af7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:45.177714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:45.595107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:55.994293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348840-32fe-41b1-ae5b-c8cb7341c737 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:55.994781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348840-32fe-41b1-ae5b-c8cb7341c737 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:55.994904 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348840-32fe-41b1-ae5b-c8cb7341c737 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.996221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1398/2786] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 29 02:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:19:56.001088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563244f9-15f0-4efd-813e-9b4d733c54a4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:56.001529 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563244f9-15f0-4efd-813e-9b4d733c54a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:56.001673 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563244f9-15f0-4efd-813e-9b4d733c54a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:56.079576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-563244f9-15f0-4efd-813e-9b4d733c54a4 None None] MFA Rules not processed for user `8f41d973ed984648b99e75f4678575d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:56.080773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-563244f9-15f0-4efd-813e-9b4d733c54a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:56.197335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1389/2787] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 29 02:19:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:56.204940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348840-32fe-41b1-ae5b-c8cb7341c737 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:56.219261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348840-32fe-41b1-ae5b-c8cb7341c737 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:56.225861 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:56.226970 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:56.227599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:56.227831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:56.229661 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:56.242362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:56.243853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7053-c8d2-47de-b016-6e717317dc37 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:56.253590 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1399/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:06.195615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=74 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:06.249364 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:26.162587 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.163928 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.164684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.166396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1390/2789] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:20:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:20:26.173045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b9d0-5d76-43ff-a2b8-fbfaafb7afbf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.173629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b9d0-5d76-43ff-a2b8-fbfaafb7afbf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.173629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b9d0-5d76-43ff-a2b8-fbfaafb7afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.207693 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b726b9d0-5d76-43ff-a2b8-fbfaafb7afbf None None] MFA Rules not processed for user `420c2ac652344d45a417f490e095a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:26.209032 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b726b9d0-5d76-43ff-a2b8-fbfaafb7afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:26.271585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1400/2790] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:20:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:26.283889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:26.285748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:26.303746 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76237-3e65-4c28-a51a-d44b6bcafcf5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:26.307366 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:26.307967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.308247 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.308518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.315531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:26.316983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6f9f3-6493-4674-8e88-4c7373f4f764 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:26.324676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1391/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:26.407703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393697a-9853-42da-9001-ca50a4d71a52 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.407999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393697a-9853-42da-9001-ca50a4d71a52 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.408304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393697a-9853-42da-9001-ca50a4d71a52 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.409655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1401/2792] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 29 02:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:20:26.415464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.415758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.416043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.448513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] MFA Rules not processed for user `b95c7c9fe9fa4536a3bcd298cfc7f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:26.449950 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:26.531635 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1392/2793] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 29 02:20:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:26.542759 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393697a-9853-42da-9001-ca50a4d71a52 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:26.554110 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393697a-9853-42da-9001-ca50a4d71a52 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:26.557576 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:26.558159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:26.558438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:26.558718 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:26.568435 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:26.569930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:26.580231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1402/2794] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:36.528736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=49 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:36.575766 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=38 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:42.825883 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:42.827370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:42.925903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c059-0683-4b5d-90cb-1e6f7f7b5263 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:42.930632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:42.931262 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:42.931549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:42.931821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] PATH_INFO: `/v3/users/9c68e1e3809a472eaf5db0e573a2578c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:42.932949 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c68e1e3809a472eaf5db0e573a2578c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:42.934903 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:42.982399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c68e1e3809a472eaf5db0e573a2578c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:42.989074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c68e1e3809a472eaf5db0e573a2578c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:42.989769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c68e1e3809a472eaf5db0e573a2578c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:42.990437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c68e1e3809a472eaf5db0e573a2578c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:42.997978 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7174c5e-c89a-48b4-9111-afd16ad403b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c68e1e3809a472eaf5db0e573a2578c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.016004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1393/2795] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:20:42 2022] DELETE /identity/v3/users/9c68e1e3809a472eaf5db0e573a2578c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:43.191818 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.203166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd03b6-93c0-4ec4-aab1-3415be1e58ff service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.261359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.262221 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.262517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.262795 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] PATH_INFO: `/v3/projects/8c612ba3f54c4f4e8313dcef73afc483` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.263993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c612ba3f54c4f4e8313dcef73afc483)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.265949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.311280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c612ba3f54c4f4e8313dcef73afc483', 'request_id': 'req-93e20ae8-bce2-4354-be82-d3006157ed53'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.316723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c612ba3f54c4f4e8313dcef73afc483', 'request_id': 'req-93e20ae8-bce2-4354-be82-d3006157ed53'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.323346 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c612ba3f54c4f4e8313dcef73afc483', 'request_id': 'req-93e20ae8-bce2-4354-be82-d3006157ed53'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.335951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] The token cache is being invalidate because project 8c612ba3f54c4f4e8313dcef73afc483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:20:43.336242 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.336868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-93e20ae8-bce2-4354-be82-d3006157ed53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:43.338371 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1403/2796] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:20:43 2022] DELETE /identity/v3/projects/8c612ba3f54c4f4e8313dcef73afc483 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:43.343866 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.344175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.344452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.392096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:43.393326 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:43.419516 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:43.457622 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1394/2797] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:43.466014 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.466378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.466657 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.487253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:43.488441 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:43.497684 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1404/2798] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:43.501917 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.511897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef9843-f0e6-44f8-9fd6-bf29699e7f80 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.516689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.517298 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.517616 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.517894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.518541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:20:43.518848 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.520440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.532074 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1395/2799] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:20:43.536314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.546106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c0b2-2e56-487c-b0cb-0a361864069e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.550771 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.551367 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.551652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.551931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.552571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.555154 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.583563 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1405/2800] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:43.588211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.598095 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5da7-4537-4f86-854b-65489951607b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.653962 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.654571 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.654880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.655130 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.655757 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.657702 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.679579 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1396/2801] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:43.683874 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.694232 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a4bb-598b-4df8-9e2d-445b839dbced admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.699131 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.699738 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.700024 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.700299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.700944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.702588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.716822 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1406/2802] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:43.720789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.731438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7953-633b-425e-831f-453f0f4597df admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.736148 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.736755 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.737036 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.737311 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.738000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.739597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650071-58d2-4084-9e88-203852e8fa17 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.750717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1397/2803] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:43.757280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.767646 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab1052-8ff0-4c7e-8c92-9e17c84d6635 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.773574 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.774240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.774523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.774798 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] PATH_INFO: `/v3/projects/e790c5088d2c451eb05d52ea88e9bd74/users/93671479ff454860a949fb90aa86b479/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.790236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e790c5088d2c451eb05d52ea88e9bd74, user_id=93671479ff454860a949fb90aa86b479, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.792914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:43.806099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1407/2804] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:43 2022] PUT /identity/v3/projects/e790c5088d2c451eb05d52ea88e9bd74/users/93671479ff454860a949fb90aa86b479/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:43.818497 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.818777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.819050 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.848209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] MFA Rules not processed for user `93671479ff454860a949fb90aa86b479`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:43.849457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:43.915867 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1398/2805] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:43.920410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:43.949765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:43.984626 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f878b-45a8-4091-8756-0d51546f6d37 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:43.989486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:43.990136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:43.990423 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:43.990777 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:43.991459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:43.993382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.020109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1408/2806] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:43 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:44.025117 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.035774 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362d6e-0088-436f-96ac-9298bf1db3c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.057337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:44.097238 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.097983 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.098269 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.098541 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.099182 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.101727 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.123740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1399/2807] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:44 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:44.127697 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.138159 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4c0d8-7a3b-4f63-bb4f-e9bdc77e47b4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.142786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.143398 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.143673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.143944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.144701 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.146252 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.157753 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1409/2808] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:44.161894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.172519 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd9a3b-cfc5-4f6b-adc6-09ef6523ae98 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.177474 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.178288 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.178575 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.178856 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] PATH_INFO: `/v3/projects/1814a895e0124cd99bc7d17777e06540/users/950462161345472887e2c1e343a70d71/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.194149 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1814a895e0124cd99bc7d17777e06540, user_id=950462161345472887e2c1e343a70d71, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.196804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.210370 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1400/2809] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:44 2022] PUT /identity/v3/projects/1814a895e0124cd99bc7d17777e06540/users/950462161345472887e2c1e343a70d71/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:44.214662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.224662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2b6b-a8fa-46eb-b259-c31ad1c55145 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.282767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.283290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.283572 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.283846 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.284486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.286109 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e241499-4d57-4c7a-84a1-d280fb5056b1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.296039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1410/2810] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:44.300211 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.310432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49708d-86ef-4fab-b2d2-235dadf639e2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.315097 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.315756 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.316040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.316318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] PATH_INFO: `/v3/projects/1814a895e0124cd99bc7d17777e06540/users/950462161345472887e2c1e343a70d71/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.318237 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1814a895e0124cd99bc7d17777e06540, user_id=950462161345472887e2c1e343a70d71, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.321372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.331592 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1401/2811] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:44 2022] PUT /identity/v3/projects/1814a895e0124cd99bc7d17777e06540/users/950462161345472887e2c1e343a70d71/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:20:44.342749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.343055 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.343309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.371206 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] MFA Rules not processed for user `950462161345472887e2c1e343a70d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:44.372408 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:44.441147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1411/2812] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:44.452904 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.454648 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:44.534440 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8eda-5dc5-474c-be4a-6b347bd53690 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.538176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.538824 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.539108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.539385 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.548438 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.549901 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.559327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1402/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:44.635940 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:44.645432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321a042-a1c6-4d3e-b5ed-3e6f1bad9f58 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:44.649056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:44.649692 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:44.649975 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:44.650248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:44.669230 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:44.711280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:44.712748 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe028e-e183-440c-9862-d767f302de7c service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:44.721631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1412/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:50.664104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:50.728804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a012e-8206-40bc-8cb7-0aaaf28e6b53 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:50.733396 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:50.734069 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:50.734353 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:50.734636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] PATH_INFO: `/v3/users/93671479ff454860a949fb90aa86b479` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:50.735915 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93671479ff454860a949fb90aa86b479)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:50.737882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:50.739444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:50.790510 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93671479ff454860a949fb90aa86b479'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:50.797520 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93671479ff454860a949fb90aa86b479'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:50.798318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93671479ff454860a949fb90aa86b479'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:50.798948 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93671479ff454860a949fb90aa86b479'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:50.807351 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93671479ff454860a949fb90aa86b479'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:50.826086 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1403/2815] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:20:50 2022] DELETE /identity/v3/users/93671479ff454860a949fb90aa86b479 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:50.830689 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:50.831147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:50.831247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:50.850300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:50.851510 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:50.909837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1413/2816] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:50.919546 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:50.920982 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:50.978729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d3d05-ad97-4222-b32d-6264d46da630 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:50.982380 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:50.982985 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:50.983263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:50.983532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:50.993128 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:50.994734 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:51.004029 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1404/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:51.278089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:51.279629 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:51.291609 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca6432-590e-4bce-a8da-faa73222be59 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:51.296302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:51.296929 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:51.297208 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:51.297476 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] PATH_INFO: `/v3/projects/e790c5088d2c451eb05d52ea88e9bd74` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:51.298664 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e790c5088d2c451eb05d52ea88e9bd74)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:51.300564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:51.347878 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e790c5088d2c451eb05d52ea88e9bd74', 'request_id': 'req-dc49270b-6cd7-493b-8fda-ccebf0507fbd'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.353616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e790c5088d2c451eb05d52ea88e9bd74', 'request_id': 'req-dc49270b-6cd7-493b-8fda-ccebf0507fbd'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.360142 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e790c5088d2c451eb05d52ea88e9bd74', 'request_id': 'req-dc49270b-6cd7-493b-8fda-ccebf0507fbd'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.373169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] The token cache is being invalidate because project e790c5088d2c451eb05d52ea88e9bd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:20:51.373456 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.374101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.375575 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1414/2818] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:20:51 2022] DELETE /identity/v3/projects/e790c5088d2c451eb05d52ea88e9bd74 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:51.379706 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:51.389947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8ffd-9739-470e-a285-d4021a78c00b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:51.445342 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:51.446000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:51.446279 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:51.446548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] PATH_INFO: `/v3/users/950462161345472887e2c1e343a70d71` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:51.447664 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950462161345472887e2c1e343a70d71)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:51.449644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:51.471989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:51.499200 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950462161345472887e2c1e343a70d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.506599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950462161345472887e2c1e343a70d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.507309 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950462161345472887e2c1e343a70d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.507944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950462161345472887e2c1e343a70d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.515312 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d35b2b9-86b4-4fb2-beef-fddfd96a6947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950462161345472887e2c1e343a70d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.532180 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1405/2819] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:20:51 2022] DELETE /identity/v3/users/950462161345472887e2c1e343a70d71 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:51.807524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:51.808957 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:51.822305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49270b-6cd7-493b-8fda-ccebf0507fbd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:51.868751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:51.886169 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:51.886737 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:51.887015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:51.887287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] PATH_INFO: `/v3/projects/1814a895e0124cd99bc7d17777e06540` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:51.888391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1814a895e0124cd99bc7d17777e06540)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:51.890631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:51.936120 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1814a895e0124cd99bc7d17777e06540', 'request_id': 'req-5aabdbbf-d090-4430-915e-463e550d8b2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.941498 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1814a895e0124cd99bc7d17777e06540', 'request_id': 'req-5aabdbbf-d090-4430-915e-463e550d8b2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.947582 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1814a895e0124cd99bc7d17777e06540', 'request_id': 'req-5aabdbbf-d090-4430-915e-463e550d8b2a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.960486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] The token cache is being invalidate because project 1814a895e0124cd99bc7d17777e06540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:20:51.960807 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.961432 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5aabdbbf-d090-4430-915e-463e550d8b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:51.962931 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1415/2820] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:20:51 2022] DELETE /identity/v3/projects/1814a895e0124cd99bc7d17777e06540 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:51.967834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:51.968305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:51.968427 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:51.988198 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:51.989394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:52.047088 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1406/2821] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:52.056989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.057302 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.057630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.077314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:52.078568 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:52.087505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1416/2822] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:52.091719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.102694 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4a88-4b2d-4005-9377-1755538e59e1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.106880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.107488 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.107765 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.108038 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.108681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:20:52.108984 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.110689 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.123570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1407/2823] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:20:52.128097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.137471 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717be32-8930-4bce-8023-53a5ee21e3bb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.142386 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.142977 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.143259 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.143529 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.144152 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.146868 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.178602 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1417/2824] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:52.182834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.192799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f127-8b49-41c7-a20d-6562ff02cd75 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.249846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.250450 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.250736 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.251013 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.251642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.253583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.274051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1408/2825] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:20:52.278170 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.289749 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a311-eb92-4425-baff-bc80c46d1dc6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.294347 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.294943 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.295222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.295495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.296136 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.297760 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.307949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1418/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:52.311758 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.321754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2e5e-7e9f-456a-be76-30f4263a783a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.326365 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.326959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.327244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.327521 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.328165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.329813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f4b16-64f3-4153-8f74-e9477c51241c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.341015 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1409/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:20:52.345140 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.355850 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726999a-adaa-4b08-bf16-b0b560a2ca51 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.360457 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.361383 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.361698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.361972 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] PATH_INFO: `/v3/projects/33a324a2650240dd97207b2d6cc8b595/users/e8313a4726ac4b18844879f6e05232b4/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.376895 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a324a2650240dd97207b2d6cc8b595, user_id=e8313a4726ac4b18844879f6e05232b4, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.379544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.392236 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1419/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:52 2022] PUT /identity/v3/projects/33a324a2650240dd97207b2d6cc8b595/users/e8313a4726ac4b18844879f6e05232b4/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:52.403177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.403465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.403766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.417763 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:52.433052 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] MFA Rules not processed for user `e8313a4726ac4b18844879f6e05232b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:52.434310 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:52.497783 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1410/2829] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:52.502247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.564145 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462dc2-92f1-4469-ab62-9ea4ddf9d031 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.569492 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.570198 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.570480 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.570746 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.571381 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.573285 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.588899 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:52.604282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1420/2830] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:52.608266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.619175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7590-9f6f-4095-883c-621ca69b82bc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.677002 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.677609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.677906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.678274 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.678910 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.680853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.715801 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1411/2831] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:52.719926 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.730920 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5a72-2ae6-4ed5-ae45-10bb7becf777 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.735517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.736112 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.736393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.736662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.737299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.738933 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.750005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1421/2832] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:52.754560 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.766126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83b89a-d0ed-4909-8bfe-27c22c492538 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.770759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.771989 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.772291 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.772570 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] PATH_INFO: `/v3/projects/0ceb7da394224f0e949ed2076bb03031/users/4512698ef10e4757bb998e7c48e61104/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.788916 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceb7da394224f0e949ed2076bb03031, user_id=4512698ef10e4757bb998e7c48e61104, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.791615 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.804114 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1412/2833] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:52 2022] PUT /identity/v3/projects/0ceb7da394224f0e949ed2076bb03031/users/4512698ef10e4757bb998e7c48e61104/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:20:52.808041 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.817879 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eabe1-37ab-4fa4-ae0c-b8d35fdd45dd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.876918 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.877734 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.877853 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.878133 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.879605 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.881860 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32fc78-6e66-40bf-afad-c136d617160e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.892973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1422/2834] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:52.897120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:52.907404 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd474-f614-4d0a-8425-deed46dcb6ff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:52.912018 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:52.912671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.912952 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.913233 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] PATH_INFO: `/v3/projects/0ceb7da394224f0e949ed2076bb03031/users/4512698ef10e4757bb998e7c48e61104/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.915216 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceb7da394224f0e949ed2076bb03031, user_id=4512698ef10e4757bb998e7c48e61104, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:52.917891 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:52.928939 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1413/2835] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:52 2022] PUT /identity/v3/projects/0ceb7da394224f0e949ed2076bb03031/users/4512698ef10e4757bb998e7c48e61104/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:52.938995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:52.939284 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:52.939561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:52.967713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] MFA Rules not processed for user `4512698ef10e4757bb998e7c48e61104`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:52.969059 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:53.036649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1423/2836] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:53.048051 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:53.049865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:53.106642 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:53.111732 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626449-37da-4212-9f29-79b36f371632 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:53.116393 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:53.117006 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:53.117284 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:53.117590 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:53.126670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:53.128107 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:53.138455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1414/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:53.221190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:53.231719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec21ef-3a36-4fdd-9189-a04c2152680c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:53.235301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:53.235909 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:53.236185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:53.236482 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:53.297373 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:53.298847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486cf4-b97a-4558-b777-b31402d32c01 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:53.308397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1424/2838] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:56.033778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:56.098525 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585d79-7304-4c61-8f47-79420049d6b6 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:56.103324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:56.103960 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:56.104241 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:56.104513 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] PATH_INFO: `/v3/users/e8313a4726ac4b18844879f6e05232b4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:56.105700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8313a4726ac4b18844879f6e05232b4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:56.107621 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:56.154093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8313a4726ac4b18844879f6e05232b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.161063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8313a4726ac4b18844879f6e05232b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.161769 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8313a4726ac4b18844879f6e05232b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.162398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8313a4726ac4b18844879f6e05232b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.169894 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8313a4726ac4b18844879f6e05232b4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.187505 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1415/2839] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:20:56 2022] DELETE /identity/v3/users/e8313a4726ac4b18844879f6e05232b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:56.192279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:56.192752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:56.192852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:56.201630 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:56.213149 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:56.214387 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:56.271986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1425/2840] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:56.281629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:56.283043 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:56.340719 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5ef-6f52-4135-96bc-6af14c382315 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:56.344374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:56.344980 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:56.345261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:56.345561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:56.356787 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:56.358285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:56.368912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1416/2841] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:20:56.647474 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:56.648982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:56.663728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb47722-22a8-46bb-a3cf-9de7280f4c14 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:56.668621 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:56.669257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:56.669597 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:56.669896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] PATH_INFO: `/v3/projects/33a324a2650240dd97207b2d6cc8b595` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:56.671064 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a324a2650240dd97207b2d6cc8b595)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:56.672979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:56.719307 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a324a2650240dd97207b2d6cc8b595', 'request_id': 'req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.725671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a324a2650240dd97207b2d6cc8b595', 'request_id': 'req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.732598 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a324a2650240dd97207b2d6cc8b595', 'request_id': 'req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.748349 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] The token cache is being invalidate because project 33a324a2650240dd97207b2d6cc8b595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:20:56.748652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.749277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.750786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1426/2842] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:20:56 2022] DELETE /identity/v3/projects/33a324a2650240dd97207b2d6cc8b595 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:56.754681 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:56.764852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fa630-7bdb-42ed-899e-92d34ca0bb86 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:56.774568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:56.824515 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:56.825177 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:56.825457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:56.825764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] PATH_INFO: `/v3/users/4512698ef10e4757bb998e7c48e61104` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:56.826892 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4512698ef10e4757bb998e7c48e61104)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:56.828805 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:56.876346 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4512698ef10e4757bb998e7c48e61104'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.883401 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4512698ef10e4757bb998e7c48e61104'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.884120 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4512698ef10e4757bb998e7c48e61104'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.885039 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4512698ef10e4757bb998e7c48e61104'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.892333 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ca06b012-6f5d-4a42-8909-91d51b9ba2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4512698ef10e4757bb998e7c48e61104'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:56.910175 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1417/2843] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:20:56 2022] DELETE /identity/v3/users/4512698ef10e4757bb998e7c48e61104 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:57.183536 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.184979 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:57.198781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1dd3c-b0be-41d3-9a96-d58068b1a9ac admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.255393 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.256592 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.256928 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.257205 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] PATH_INFO: `/v3/projects/0ceb7da394224f0e949ed2076bb03031` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.258380 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ceb7da394224f0e949ed2076bb03031)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.260280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.293800 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:57.308584 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ceb7da394224f0e949ed2076bb03031', 'request_id': 'req-4c18a4dd-709d-4d2b-b543-1209a379a2c8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:57.314520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ceb7da394224f0e949ed2076bb03031', 'request_id': 'req-4c18a4dd-709d-4d2b-b543-1209a379a2c8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:57.321365 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ceb7da394224f0e949ed2076bb03031', 'request_id': 'req-4c18a4dd-709d-4d2b-b543-1209a379a2c8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:57.332765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] The token cache is being invalidate because project 0ceb7da394224f0e949ed2076bb03031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:20:57.333081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:57.334506 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4c18a4dd-709d-4d2b-b543-1209a379a2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:20:57.336015 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1427/2844] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:20:57 2022] DELETE /identity/v3/projects/0ceb7da394224f0e949ed2076bb03031 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:57.340990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.341457 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.341610 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.360959 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:57.362350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:57.422335 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1418/2845] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:57.431735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.432021 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.432296 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.453319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:57.454552 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:57.462751 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1428/2846] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:57.466895 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.477486 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756fe08-daa4-4356-bc1d-0dbd612c16b6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.482041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.482630 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.482908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.483176 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.483813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:20:57.484109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.485700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.497685 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1419/2847] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:20:57.502042 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.511787 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604541a4-87bb-4977-9327-e581f790c4b3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.516670 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.517280 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.517812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.517812 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.518827 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.521017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.547504 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1429/2848] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:57.551643 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.562777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9650-0e8c-4adb-b7e0-d87f995c1fe4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.580139 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:57.620574 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.621173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.621451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.621751 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.622368 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.624272 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.645994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1420/2849] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:57.650681 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.660916 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8a99f-1e4a-49dd-ac64-852a4a25e706 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.665888 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.666485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.666769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.667043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.667739 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.669326 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.680103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1430/2850] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:57.683963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.695093 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48530bb5-4f1e-4803-8b93-2d93a7728f96 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.699670 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.700265 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.700543 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.700810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.701445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.703063 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209093b-8532-47b9-8f72-c0c2c0889b6a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.714410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1421/2851] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:57.718714 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.729585 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b111b-f946-4c53-a15c-c224a7a46748 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.734186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.734831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.735113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.735392 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] PATH_INFO: `/v3/projects/b3952e8953a245d8ac0fc68a7bb42c9c/users/034c70d6648f4d0d84548913e0d84cd7/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.750588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3952e8953a245d8ac0fc68a7bb42c9c, user_id=034c70d6648f4d0d84548913e0d84cd7, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.753226 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.766986 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1431/2852] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:57 2022] PUT /identity/v3/projects/b3952e8953a245d8ac0fc68a7bb42c9c/users/034c70d6648f4d0d84548913e0d84cd7/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:20:57.777057 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.777343 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.777649 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.805908 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] MFA Rules not processed for user `034c70d6648f4d0d84548913e0d84cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:57.807099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:57.871554 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1422/2853] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:57.876129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.936388 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff43b1-4af0-40b7-a6a3-fe5b5af7878e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:57.940964 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:57.941587 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:57.941870 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:57.942141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:57.942769 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:57.944710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:57.972564 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1432/2854] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:57.976037 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:57.986990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728047f-5af6-497d-ac88-f4f03d08d248 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.047873 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.048498 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.048764 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.049032 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.049700 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.051675 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.074275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1423/2855] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:20:57 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:20:58.078300 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:58.089963 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc6d04-ac76-49d9-ba6f-cff074bab22e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.094949 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.095566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.095841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.096250 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.096900 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.098507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.111306 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1433/2856] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:20:58.115285 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:58.125323 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fffa4b-7034-4a6e-b2ad-e1b482f21d58 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.130010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.131091 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.131602 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.131927 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] PATH_INFO: `/v3/projects/8fcc6a79c87e47da9818414b61455bf8/users/3ef16f7a4716414c87f2e3fa2394d82d/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.146806 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcc6a79c87e47da9818414b61455bf8, user_id=3ef16f7a4716414c87f2e3fa2394d82d, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.149435 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.151629 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:58.164305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1424/2857] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:58 2022] PUT /identity/v3/projects/8fcc6a79c87e47da9818414b61455bf8/users/3ef16f7a4716414c87f2e3fa2394d82d/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:58.168282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:58.178299 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb76c8-e701-4b73-b514-3e79a7fcb794 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.203276 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:58.236789 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.237397 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.237712 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.237983 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.238616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.240404 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212037c-7589-4f99-afe2-b5e785f26669 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.250608 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1434/2858] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:20:58.254082 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:58.264714 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb4cef-29e2-409b-8a2f-9da405d4ba13 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.269394 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.270005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.270290 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.270559 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] PATH_INFO: `/v3/projects/8fcc6a79c87e47da9818414b61455bf8/users/3ef16f7a4716414c87f2e3fa2394d82d/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.273061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcc6a79c87e47da9818414b61455bf8, user_id=3ef16f7a4716414c87f2e3fa2394d82d, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.275687 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.285620 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1425/2859] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:20:58 2022] PUT /identity/v3/projects/8fcc6a79c87e47da9818414b61455bf8/users/3ef16f7a4716414c87f2e3fa2394d82d/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:58.297044 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.297337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.297645 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.325527 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] MFA Rules not processed for user `3ef16f7a4716414c87f2e3fa2394d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:58.326745 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:58.394553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1435/2860] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:20:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:58.406254 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:58.408070 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:58.466416 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1566c-e7db-4453-b5f5-ac414235039e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:58.470053 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:58.470654 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:58.470931 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:58.471201 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:58.528518 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:58.529905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:58.538655 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1426/2861] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:59.893910 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:59.895317 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:59.907671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba7c0-a95f-4299-a79f-1232e1a2dd7a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:59.911182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:59.912468 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:59.912752 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:59.913028 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:59.921765 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:59.923190 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9160-cc16-44dd-8410-b0f8fea96281 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:59.932896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1436/2862] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:03.761979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:03.824276 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b008f42-49e1-43b9-9fd8-a70c8d951e4a service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:03.828809 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:03.829437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:03.829747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:03.830022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] PATH_INFO: `/v3/users/034c70d6648f4d0d84548913e0d84cd7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:03.831142 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] RBAC: Authorizing `identity:delete_user(user_id=034c70d6648f4d0d84548913e0d84cd7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:03.833084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:03.873212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:03.883936 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034c70d6648f4d0d84548913e0d84cd7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:03.890796 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034c70d6648f4d0d84548913e0d84cd7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:03.891465 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034c70d6648f4d0d84548913e0d84cd7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:03.892080 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034c70d6648f4d0d84548913e0d84cd7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:03.899548 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034c70d6648f4d0d84548913e0d84cd7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:03.917882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1427/2863] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:03 2022] DELETE /identity/v3/users/034c70d6648f4d0d84548913e0d84cd7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:03.922290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:03.922794 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:03.922924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:03.942270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:03.943473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:04.002377 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1437/2864] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:04.012119 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:04.013517 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:04.070392 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a31f5-3e83-41ee-99d5-70eb4d8ce38d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:04.074010 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:04.074611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:04.074884 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:04.075151 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:04.084749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:04.086222 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:04.095709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1428/2865] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:04.363141 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:04.364780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:04.378165 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47199-9044-4f3f-b877-e86d2c714821 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:04.383401 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:04.384043 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:04.384321 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:04.384599 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] PATH_INFO: `/v3/projects/b3952e8953a245d8ac0fc68a7bb42c9c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:04.385852 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3952e8953a245d8ac0fc68a7bb42c9c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:04.387696 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:04.422922 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:04.435703 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3952e8953a245d8ac0fc68a7bb42c9c', 'request_id': 'req-16708aac-5259-49be-b59e-d94281fa8aca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.441229 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3952e8953a245d8ac0fc68a7bb42c9c', 'request_id': 'req-16708aac-5259-49be-b59e-d94281fa8aca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.448045 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3952e8953a245d8ac0fc68a7bb42c9c', 'request_id': 'req-16708aac-5259-49be-b59e-d94281fa8aca'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.461039 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] The token cache is being invalidate because project b3952e8953a245d8ac0fc68a7bb42c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:04.461330 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.461984 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.463501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1438/2866] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:04 2022] DELETE /identity/v3/projects/b3952e8953a245d8ac0fc68a7bb42c9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:04.467737 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:04.477588 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff72869-4e0e-4c40-8002-3cb6f58446b6 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:04.533249 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:04.533820 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:04.534099 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:04.534373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] PATH_INFO: `/v3/users/3ef16f7a4716414c87f2e3fa2394d82d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:04.535500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef16f7a4716414c87f2e3fa2394d82d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:04.537433 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:04.584402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef16f7a4716414c87f2e3fa2394d82d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.591514 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef16f7a4716414c87f2e3fa2394d82d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.592192 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef16f7a4716414c87f2e3fa2394d82d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.592798 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef16f7a4716414c87f2e3fa2394d82d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.595327 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:04.601448 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f2716bf-3c15-4034-9558-c0aeb40b8557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef16f7a4716414c87f2e3fa2394d82d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:04.620079 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1429/2867] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:04 2022] DELETE /identity/v3/users/3ef16f7a4716414c87f2e3fa2394d82d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:05.110936 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.112444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:05.126649 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708aac-5259-49be-b59e-d94281fa8aca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.183277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.183907 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.184189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.184462 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] PATH_INFO: `/v3/projects/8fcc6a79c87e47da9818414b61455bf8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.185627 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcc6a79c87e47da9818414b61455bf8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.187535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.235309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcc6a79c87e47da9818414b61455bf8', 'request_id': 'req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:05.241487 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcc6a79c87e47da9818414b61455bf8', 'request_id': 'req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:05.247517 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcc6a79c87e47da9818414b61455bf8', 'request_id': 'req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:05.260035 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] The token cache is being invalidate because project 8fcc6a79c87e47da9818414b61455bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:05.260325 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:05.260962 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ce3380be-cb3f-47e1-9c1c-3fe71e16497d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:05.262463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1439/2868] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:05 2022] DELETE /identity/v3/projects/8fcc6a79c87e47da9818414b61455bf8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:05.267277 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.267777 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.267886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.288073 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:05.289208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:05.348835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1430/2869] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:05.356520 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.356813 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.357093 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.376485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:05.377717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:05.386209 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1440/2870] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:05.390266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.400524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554387-5609-4a52-8827-b7a8f39512d4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.405087 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.405717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.406000 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.406270 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.406905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:05.407208 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.408795 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.420104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1431/2871] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:05.424361 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.433648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05a138-ae6b-4948-874f-598d6807038e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.438304 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.438897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.439183 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.439460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.440089 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.442017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.470559 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1441/2872] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:05.474603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.484408 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e6c2-ecb8-414b-add2-dbb5ce17cd99 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.541106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.541650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.541929 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.542194 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.542815 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.544709 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.565650 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1432/2873] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:05.570841 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.580930 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfada1-e37c-4869-9c5b-d8211dd5b3ca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.586837 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.587442 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.587727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.588005 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.588648 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.590290 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.600277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1442/2874] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:05.604217 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.613988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddca3ac-278b-4eeb-8c43-2e8277a5c1a1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.619042 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.619632 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.619912 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.620186 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.620849 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.622455 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a8fa7-c500-464a-a1ab-9e671a9fde44 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.633445 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1433/2875] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:05.637451 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.647459 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cae2-09eb-4101-9c39-2789c22e4438 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.652485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.653144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.653425 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.653727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] PATH_INFO: `/v3/projects/ed1db1e3db8b4aa7a7af53feac58d784/users/4bb62ab20d6d4cb5ab97fcfaae249793/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.662473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:05.670588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1db1e3db8b4aa7a7af53feac58d784, user_id=4bb62ab20d6d4cb5ab97fcfaae249793, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.673775 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.687253 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1443/2876] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:05 2022] PUT /identity/v3/projects/ed1db1e3db8b4aa7a7af53feac58d784/users/4bb62ab20d6d4cb5ab97fcfaae249793/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:05.697647 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.697937 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.698213 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.726355 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] MFA Rules not processed for user `4bb62ab20d6d4cb5ab97fcfaae249793`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:05.727750 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:05.758196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:05.793810 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1434/2877] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:05.798311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.859655 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e72e-3273-4b0c-8b52-fbce2fe42da0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.864440 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.866099 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.866486 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.866816 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.867652 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.869801 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.898337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1444/2878] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:05.900294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:05.910625 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7403-2ba5-4e10-9b72-0d48dcf8af01 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:05.966956 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:05.967549 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:05.967832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:05.968101 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:05.968724 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:05.970660 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:05.992528 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1435/2879] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:05.996495 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.007097 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c86-4b1a-4088-97ba-36c4dc3eb521 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.011659 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.012247 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.012525 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.012797 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.013430 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.015051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.025717 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1445/2880] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:06.029491 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.039944 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b51de-2f68-4508-acca-f9e846d5a0ab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.044611 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.045147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.045432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.045747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.046387 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.047967 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e186-f07d-4b7d-ab38-7ec27a20f3e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.058428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1436/2881] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:06.062566 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.072628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd65aa-df04-43c4-bbe6-6a7b7266ef00 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.077293 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.077971 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.078305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.078678 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] PATH_INFO: `/v3/projects/baa1ff50056a40daa8127a96b99bc136/users/dddd4e48a49247f6a1a6ab08619efdb7/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.093653 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa1ff50056a40daa8127a96b99bc136, user_id=dddd4e48a49247f6a1a6ab08619efdb7, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.100452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.111075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1446/2882] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:06 2022] PUT /identity/v3/projects/baa1ff50056a40daa8127a96b99bc136/users/dddd4e48a49247f6a1a6ab08619efdb7/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:06.123196 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.123479 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.123749 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.151947 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] MFA Rules not processed for user `dddd4e48a49247f6a1a6ab08619efdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:06.153147 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:06.217607 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1437/2883] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:06.222200 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.282836 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac9d26-b6a5-4979-897e-d3ad15f60eb7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.288196 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.288806 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.289091 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.289369 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.290040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.292001 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.318722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1447/2884] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:06.322686 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.333799 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627a49b-31c6-4298-8179-1c8f8c5d5adb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.371862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:06.391137 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.391753 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.392040 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.392317 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.392954 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.394930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.417350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1438/2885] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:06.421466 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.432103 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017645-4f79-4834-b38a-53e3a7bce134 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.436776 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.437376 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.437719 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.437997 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.438635 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.440227 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.450844 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1448/2886] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:06.454860 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.465779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c285e-885a-4b86-bfa0-a2a105b03825 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.470729 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.471507 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.471779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.472124 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] PATH_INFO: `/v3/projects/1394edf8ef9b4ea1aea752723895320c/users/634eb5ec295045e6907ddbd023910416/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.488046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1394edf8ef9b4ea1aea752723895320c, user_id=634eb5ec295045e6907ddbd023910416, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.491129 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.503762 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1439/2887] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:06 2022] PUT /identity/v3/projects/1394edf8ef9b4ea1aea752723895320c/users/634eb5ec295045e6907ddbd023910416/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:06.507688 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.517865 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37df3a-d39e-4c30-8df3-13a603964a1f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.526288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:06.575050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.575694 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.575987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.576267 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.576914 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.578548 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a10cf-b1b3-419f-a8b0-027b88f2a322 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.588999 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1449/2888] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:06.593115 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.604026 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9760f-b0f2-450c-98a2-a47702b45eaf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.608667 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.609318 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.609639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.609920 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] PATH_INFO: `/v3/projects/1394edf8ef9b4ea1aea752723895320c/users/634eb5ec295045e6907ddbd023910416/roles/91c74d335ba54b558054c228da1b6365` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.611846 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1394edf8ef9b4ea1aea752723895320c, user_id=634eb5ec295045e6907ddbd023910416, role_id=91c74d335ba54b558054c228da1b6365)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.614677 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.624672 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1440/2889] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:06 2022] PUT /identity/v3/projects/1394edf8ef9b4ea1aea752723895320c/users/634eb5ec295045e6907ddbd023910416/roles/91c74d335ba54b558054c228da1b6365 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:06.634824 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.635115 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.635438 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.663847 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] MFA Rules not processed for user `634eb5ec295045e6907ddbd023910416`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:06.665057 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:06.731396 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1450/2890] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:06.742747 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.744441 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:06.801790 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c7965-1a20-49b1-a2df-a24ab8a60df3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.805444 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.806190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.806481 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.806759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.863504 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.865957 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.876580 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1441/2891] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:08.376532 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:08.377953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:08.389674 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21842507-b373-4b2b-b0b7-95fe21cb4e71 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:08.393137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:08.393762 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:08.394040 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:08.394312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:08.451053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:08.452557 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:08.461715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1451/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:08.995639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:09.004399 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b88621-fb40-4add-98c4-3f746c2a7dcd service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:09.008494 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:09.009090 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:09.009369 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:09.009671 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:09.018449 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:09.019858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e911233-34aa-41d7-a377-214038f7fbb2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:09.029717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1442/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:12.897356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:12.931279 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:12.961132 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290a64a-ee59-42f6-b828-64743e6f57e7 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:12.965809 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:12.966447 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:12.966728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:12.967003 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] PATH_INFO: `/v3/users/4bb62ab20d6d4cb5ab97fcfaae249793` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:12.968129 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb62ab20d6d4cb5ab97fcfaae249793)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:12.970101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:13.016175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb62ab20d6d4cb5ab97fcfaae249793'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.023238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb62ab20d6d4cb5ab97fcfaae249793'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.023896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb62ab20d6d4cb5ab97fcfaae249793'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.031604 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb62ab20d6d4cb5ab97fcfaae249793'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.044177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb62ab20d6d4cb5ab97fcfaae249793'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.049897 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1452/2894] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:12 2022] DELETE /identity/v3/users/4bb62ab20d6d4cb5ab97fcfaae249793 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:13.055302 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:13.055804 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:13.055921 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:13.074638 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:13.075876 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:13.108674 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:13.139275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1443/2895] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:13.149640 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:13.151075 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:13.210048 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190993ff-fd9b-4e41-ad34-d10a8e5e2ed6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:13.213786 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:13.214391 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:13.214675 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:13.214953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:13.224000 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:13.226031 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:13.235470 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1453/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:13.501096 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:13.502597 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:13.516266 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153ae61-bbcd-4c77-992a-7f88a39b51e8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:13.522235 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:13.522639 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:13.522868 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:13.523189 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] PATH_INFO: `/v3/projects/ed1db1e3db8b4aa7a7af53feac58d784` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:13.524585 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1db1e3db8b4aa7a7af53feac58d784)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:13.526532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:13.579738 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1db1e3db8b4aa7a7af53feac58d784', 'request_id': 'req-c3d738a0-fd01-44bc-9989-6c0084583b24'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.586223 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1db1e3db8b4aa7a7af53feac58d784', 'request_id': 'req-c3d738a0-fd01-44bc-9989-6c0084583b24'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.592464 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1db1e3db8b4aa7a7af53feac58d784', 'request_id': 'req-c3d738a0-fd01-44bc-9989-6c0084583b24'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.606676 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] The token cache is being invalidate because project ed1db1e3db8b4aa7a7af53feac58d784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:13.606970 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.607593 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.609106 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1444/2897] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:13 2022] DELETE /identity/v3/projects/ed1db1e3db8b4aa7a7af53feac58d784 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:13.613068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:13.623240 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09cb6-3ca9-4c52-a2e0-99e6954dcdd7 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:13.671982 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:13.682722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:13.683355 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:13.683631 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:13.683903 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] PATH_INFO: `/v3/users/dddd4e48a49247f6a1a6ab08619efdb7` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:13.685007 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddd4e48a49247f6a1a6ab08619efdb7)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:13.686944 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:13.732519 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddd4e48a49247f6a1a6ab08619efdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.739356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddd4e48a49247f6a1a6ab08619efdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.740113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddd4e48a49247f6a1a6ab08619efdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.746713 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddd4e48a49247f6a1a6ab08619efdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.759501 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddd4e48a49247f6a1a6ab08619efdb7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:13.765426 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1454/2898] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:13 2022] DELETE /identity/v3/users/dddd4e48a49247f6a1a6ab08619efdb7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:14.038992 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:14.040456 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:14.056325 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d738a0-fd01-44bc-9989-6c0084583b24 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:14.119704 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:14.120337 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.120614 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.120886 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] PATH_INFO: `/v3/projects/baa1ff50056a40daa8127a96b99bc136` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.122024 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa1ff50056a40daa8127a96b99bc136)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:14.123925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:14.175786 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa1ff50056a40daa8127a96b99bc136', 'request_id': 'req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.181821 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa1ff50056a40daa8127a96b99bc136', 'request_id': 'req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.182913 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:14.188816 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa1ff50056a40daa8127a96b99bc136', 'request_id': 'req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.203258 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] The token cache is being invalidate because project baa1ff50056a40daa8127a96b99bc136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:14.203553 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.204203 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.205754 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1445/2899] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:14 2022] DELETE /identity/v3/projects/baa1ff50056a40daa8127a96b99bc136 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:14.210201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:14.211654 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:14.224989 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302337-d148-4cfa-b14c-7e366f9bce36 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:14.280876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:14.281523 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.281831 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.282106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] PATH_INFO: `/v3/users/634eb5ec295045e6907ddbd023910416` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.283215 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634eb5ec295045e6907ddbd023910416)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:14.285185 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:14.342988 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634eb5ec295045e6907ddbd023910416'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.350358 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634eb5ec295045e6907ddbd023910416'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.351020 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634eb5ec295045e6907ddbd023910416'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.358617 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634eb5ec295045e6907ddbd023910416'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.366887 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:14.372106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-326bb05c-7d39-4f5d-8718-89ffe7ba7ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634eb5ec295045e6907ddbd023910416'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.379343 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1455/2900] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:14 2022] DELETE /identity/v3/users/634eb5ec295045e6907ddbd023910416 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:14.648183 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:14.649857 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:14.664376 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fd45-47d0-45aa-8637-4279a2ad7bfb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:14.728716 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:14.729273 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.729582 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.729858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] PATH_INFO: `/v3/projects/1394edf8ef9b4ea1aea752723895320c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.731005 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1394edf8ef9b4ea1aea752723895320c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:14.733104 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:14.779094 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1394edf8ef9b4ea1aea752723895320c', 'request_id': 'req-04a9758a-3cf8-4945-8517-72cd83b5ea16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.784640 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1394edf8ef9b4ea1aea752723895320c', 'request_id': 'req-04a9758a-3cf8-4945-8517-72cd83b5ea16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.791402 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1394edf8ef9b4ea1aea752723895320c', 'request_id': 'req-04a9758a-3cf8-4945-8517-72cd83b5ea16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.803275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] The token cache is being invalidate because project 1394edf8ef9b4ea1aea752723895320c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:14.803562 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.804174 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-04a9758a-3cf8-4945-8517-72cd83b5ea16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:14.805699 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1446/2901] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:14 2022] DELETE /identity/v3/projects/1394edf8ef9b4ea1aea752723895320c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:14.810550 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773496-72cc-4969-b095-ec980e54299f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.810839 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773496-72cc-4969-b095-ec980e54299f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.811113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773496-72cc-4969-b095-ec980e54299f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.830257 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-21773496-72cc-4969-b095-ec980e54299f None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:14.831444 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-21773496-72cc-4969-b095-ec980e54299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:14.891722 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1456/2902] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:14.900771 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.901061 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.901338 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.921832 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:14.922988 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:14.930994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1447/2903] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:14.935238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773496-72cc-4969-b095-ec980e54299f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:14.945580 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773496-72cc-4969-b095-ec980e54299f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:14.950378 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:14.950987 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.951270 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.951545 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.952186 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:14.952490 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:14.954189 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:14.966780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1457/2904] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:14.970885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:14.980400 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994720a5-e9a9-48a0-ba80-2f3f688d1820 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:14.984953 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:14.985603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:14.985879 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:14.986145 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:14.986778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:14.988761 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.015862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1448/2905] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:14 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:15.020311 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:15.031068 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9bbdf-7371-4832-89b7-aebdeb68eb5c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:15.087535 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:15.088173 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.088452 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.088723 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.089342 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:15.091289 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.113113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1458/2906] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:15 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:15.117482 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:15.127603 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499634a-7dfc-49bd-9c75-d8755e2c5a6b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:15.132906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:15.133496 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.133807 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.134078 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.134712 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:15.136282 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.145934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1449/2907] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:15.150464 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:15.160402 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139930-b211-4445-89e2-c4cb56b46bc0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:15.165081 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:15.165709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.165990 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.166301 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.166908 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:15.168507 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e6d98-8819-4665-b5b7-cb3a97ce08d1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.178485 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1459/2908] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:15.182566 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:15.192766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec095-7c96-406e-826d-5ed1e1adf51c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:15.198244 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:15.198888 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.199171 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.199447 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] PATH_INFO: `/v3/projects/7a0550ba7c834cfbbd510d8b4cbd6b2c/users/6a24f2faed9f43d28b5d19d18403707d/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.214487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0550ba7c834cfbbd510d8b4cbd6b2c, user_id=6a24f2faed9f43d28b5d19d18403707d, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:15.217126 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.229636 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1450/2909] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:15 2022] PUT /identity/v3/projects/7a0550ba7c834cfbbd510d8b4cbd6b2c/users/6a24f2faed9f43d28b5d19d18403707d/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:15.241017 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.241611 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.241866 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.271780 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] MFA Rules not processed for user `6a24f2faed9f43d28b5d19d18403707d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:15.273849 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:15.318309 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:15.339362 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1460/2910] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:21:15.350430 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:15.352218 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:15.366994 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:15.410212 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc16464-4236-4885-8d77-bf232ab0c4f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:15.413897 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:15.414500 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:15.414784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:15.415084 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:15.423410 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:15.424828 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294be4-4a2e-4e39-ae5b-94350be0d2f4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:15.434025 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1451/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:25.336479 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:25.430108 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=20 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:46.356921 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:46.418292 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce5031-75ee-4abf-9b2e-83d77c940a0a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:46.423053 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:46.423673 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:46.423951 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:46.424222 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] PATH_INFO: `/v3/users/6a24f2faed9f43d28b5d19d18403707d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:46.425337 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a24f2faed9f43d28b5d19d18403707d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:46.427288 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:46.472412 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a24f2faed9f43d28b5d19d18403707d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:46.479268 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a24f2faed9f43d28b5d19d18403707d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:46.479924 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a24f2faed9f43d28b5d19d18403707d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:46.487571 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a24f2faed9f43d28b5d19d18403707d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:46.500201 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a24f2faed9f43d28b5d19d18403707d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:46.506164 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1461/2912] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:46 2022] DELETE /identity/v3/users/6a24f2faed9f43d28b5d19d18403707d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:46.510586 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:46.511072 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:46.511178 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:46.532717 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:46.533963 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:46.592321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1452/2913] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:21:46.602147 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:46.603589 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:46.659733 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d5ad-7020-470c-b5d3-1fbc2e0d0b9c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:46.663356 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:46.663953 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:46.664231 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:46.664500 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:46.673350 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:46.674799 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75413711-292d-47dc-b380-80ebe4bd0532 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:46.684137 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1462/2914] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:46.954420 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:46.955878 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:46.967766 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b92a6-6da6-4faf-9f63-29db9375360c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:46.972656 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:46.973350 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:46.973730 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:46.974007 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] PATH_INFO: `/v3/projects/7a0550ba7c834cfbbd510d8b4cbd6b2c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:46.975134 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0550ba7c834cfbbd510d8b4cbd6b2c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:46.977109 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.025375 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0550ba7c834cfbbd510d8b4cbd6b2c', 'request_id': 'req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:47.030813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0550ba7c834cfbbd510d8b4cbd6b2c', 'request_id': 'req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:47.036975 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0550ba7c834cfbbd510d8b4cbd6b2c', 'request_id': 'req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:47.049526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] The token cache is being invalidate because project 7a0550ba7c834cfbbd510d8b4cbd6b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:47.049822 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:47.050471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddfcc3e9-5ed8-4d49-9d68-6138c5be14c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:47.051969 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1453/2915] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:46 2022] DELETE /identity/v3/projects/7a0550ba7c834cfbbd510d8b4cbd6b2c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:47.057182 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.057475 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.057848 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.078246 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:47.079448 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:47.104175 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:47.141727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1463/2916] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:47.149195 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.149487 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.149789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.169426 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:47.170665 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:47.179209 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1454/2917] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:47.183410 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.193736 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c88f3-fa5e-4622-86b1-ba3f8f0590da None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.198297 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.198891 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.199171 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.199445 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.200080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:47.200382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.202013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.213467 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1464/2918] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:47.217854 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.227068 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c02fb-1343-4756-84c3-4c8d7dbd5a61 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.231691 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.232281 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.232561 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.232835 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.233470 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.235905 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.273695 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1455/2919] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:47 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:47.277862 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.288359 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c15d02-71fa-4426-9034-78102e249b17 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.344460 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.345062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.345352 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.345662 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.346294 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.348219 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.370263 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1465/2920] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:47 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:47.374374 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.384669 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b42b9-0a48-4228-b92a-7e5edea64155 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.389271 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.389906 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.390191 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.390466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.391252 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.392896 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.402568 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1456/2921] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:47.406287 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.417051 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796002-0f47-419b-b882-ef2271721bae admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.421761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.422973 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.423261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.423537 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.424177 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.425819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3a71-f625-450a-b90e-da84e37910c9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.436313 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1466/2922] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:47.440808 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.450740 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88d998-07fd-4ea1-96f5-4cf5894dfc57 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.455461 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.456289 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.456583 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.456865 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] PATH_INFO: `/v3/projects/a36571adfa3d4033b8c331479bf2c8c0/users/49bd4e8a79c0468193b6eda803ba8d59/roles/a7ea816836af4541b645f88001cb4469` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.472236 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36571adfa3d4033b8c331479bf2c8c0, user_id=49bd4e8a79c0468193b6eda803ba8d59, role_id=a7ea816836af4541b645f88001cb4469)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.474934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.488283 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1457/2923] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:47 2022] PUT /identity/v3/projects/a36571adfa3d4033b8c331479bf2c8c0/users/49bd4e8a79c0468193b6eda803ba8d59/roles/a7ea816836af4541b645f88001cb4469 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:47.499790 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.500255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.500382 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.527901 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] MFA Rules not processed for user `49bd4e8a79c0468193b6eda803ba8d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:47.529117 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:47.591781 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1467/2924] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:47.603199 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:47.604847 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:47.618934 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:47.665263 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29715184-af38-47a9-981b-bbbf6ccfada3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:47.668880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '737a97e6d4b6419da95d4e1fc4618970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:47.669489 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:47.669800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:47.670077 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:47.678372 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:47.679800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6841be-cf26-4483-a7e9-4656c23ceddb service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:47.688573 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1458/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:57.588995 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:57.684523 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=21 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:57.729006 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:57.790166 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a1f9e-e6a6-4809-a434-223f6fb04e36 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:57.794628 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:57.795248 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:57.795530 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:57.795804 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] PATH_INFO: `/v3/users/49bd4e8a79c0468193b6eda803ba8d59` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:57.796896 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bd4e8a79c0468193b6eda803ba8d59)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:57.799588 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:57.847228 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bd4e8a79c0468193b6eda803ba8d59'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:57.854013 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bd4e8a79c0468193b6eda803ba8d59'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:57.854665 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bd4e8a79c0468193b6eda803ba8d59'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:57.861966 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bd4e8a79c0468193b6eda803ba8d59'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:57.874524 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bd4e8a79c0468193b6eda803ba8d59'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:57.880593 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1468/2926] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:57 2022] DELETE /identity/v3/users/49bd4e8a79c0468193b6eda803ba8d59 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:57.885158 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:57.885451 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:57.885759 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:57.904813 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] MFA Rules not processed for user `1d9dd2adfb054acebc7de33da50790a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:57.906046 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:57.963990 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1459/2927] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 29 02:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:57.974327 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:57.975698 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:58.031819 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddae3b-b95c-420b-83ad-bdb9111a7483 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:58.035458 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:58.036056 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:58.036332 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:58.036603 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:58.045709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:58.047691 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:58.057108 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1469/2928] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:58.319321 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:58.320776 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:58.333532 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa4049-a453-46fd-a84b-86d300fef74c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:58.338526 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:58.339165 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:58.339452 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:58.339728 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] PATH_INFO: `/v3/projects/a36571adfa3d4033b8c331479bf2c8c0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:58.340885 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36571adfa3d4033b8c331479bf2c8c0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:58.342833 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:58.392034 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36571adfa3d4033b8c331479bf2c8c0', 'request_id': 'req-4d457543-6922-4599-aee0-adf9e7a0ae9a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:58.397418 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36571adfa3d4033b8c331479bf2c8c0', 'request_id': 'req-4d457543-6922-4599-aee0-adf9e7a0ae9a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:58.403511 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36571adfa3d4033b8c331479bf2c8c0', 'request_id': 'req-4d457543-6922-4599-aee0-adf9e7a0ae9a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:58.416398 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] The token cache is being invalidate because project a36571adfa3d4033b8c331479bf2c8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:58.416684 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:58.417294 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:58.418773 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1460/2929] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:58 2022] DELETE /identity/v3/projects/a36571adfa3d4033b8c331479bf2c8c0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:22:08.052993 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:08.413531 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:50.744715 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:22:50.746366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:22:50.759066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c5e-6d81-4bdd-9aa2-6f5d1ca23ab8 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:22:50.807856 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:22:50.808463 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:22:50.808741 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:22:50.809012 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:22:50.810770 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:22:50.820823 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:22:50.822282 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:22:50.830772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1470/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:23:00.826710 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=26 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:02.757373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:02.759466 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:02.833599 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457543-6922-4599-aee0-adf9e7a0ae9a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:02.839085 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:02.839961 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:02.840246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:02.840524 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:02.842307 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:02.899557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:02.901122 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:02.909882 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1461/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:04.610106 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:04.635650 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f012a4-07cd-4195-ace5-51104ea24817 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:04.643544 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95c7c9fe9fa4536a3bcd298cfc7f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:04.644218 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:04.644594 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:04.644833 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:04.647197 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:04.660727 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:04.662478 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:04.676066 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1471/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:04.808713 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:04.810188 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:04.822930 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abdc5-61b3-41f3-98a5-8fbc1cdf6e25 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:04.827004 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:04.827609 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:04.827889 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:04.828163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:04.829900 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:04.844432 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:04.846022 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:04.858471 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1462/2933] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:06.051505 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:06.052925 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:06.064305 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590808-0b73-41f9-b638-c989f348ec8e service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:06.068709 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:06.069312 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:06.069616 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:06.069889 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:06.071553 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:06.085633 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:06.087050 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:06.099437 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1472/2934] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:08.595576 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:08.605275 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d820e-9e25-4aac-8cb1-6987c9643a22 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:08.608838 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420c2ac652344d45a417f490e095a217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:08.609437 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:08.609767 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:08.610041 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:08.611739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:08.675739 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:08.677163 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:08.687173 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1463/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:11.705113 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:11.706767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:11.795772 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f543ec-12e4-403e-abd4-8ca756ef8e2a service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:11.801669 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:11.802322 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:11.802671 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:11.803054 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:11.804876 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:11.817255 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:11.818913 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:11.839277 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1473/2936] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:24:14.895862 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:14.897324 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:14.910853 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9d0f7-e655-4b66-b850-b485c79420e8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:14.915556 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:14.916187 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:14.916473 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:14.916748 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] PATH_INFO: `/v3/users/2d94954c99d24dbaa0517ccc312085da` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:14.917914 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d94954c99d24dbaa0517ccc312085da)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:14.919834 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:14.933555 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:14.968557 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d94954c99d24dbaa0517ccc312085da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:14.975979 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d94954c99d24dbaa0517ccc312085da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:14.976644 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d94954c99d24dbaa0517ccc312085da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:14.977246 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d94954c99d24dbaa0517ccc312085da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:14.984742 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d94954c99d24dbaa0517ccc312085da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.002495 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1464/2937] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:24:14 2022] DELETE /identity/v3/users/2d94954c99d24dbaa0517ccc312085da => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:24:15.180069 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:15.191491 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30fafd-6d8b-435d-a917-bcdf766ff7b9 service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:15.249101 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:15.249761 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:15.250080 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:15.250366 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] PATH_INFO: `/v3/projects/692178010ed841ef989712486d2f7a2d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:15.251473 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=692178010ed841ef989712486d2f7a2d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:15.253419 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:15.298735 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692178010ed841ef989712486d2f7a2d', 'request_id': 'req-2f88b037-29de-4414-951b-c65035858957'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.304319 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692178010ed841ef989712486d2f7a2d', 'request_id': 'req-2f88b037-29de-4414-951b-c65035858957'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.310261 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692178010ed841ef989712486d2f7a2d', 'request_id': 'req-2f88b037-29de-4414-951b-c65035858957'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.312792 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:15.323477 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] The token cache is being invalidate because project 692178010ed841ef989712486d2f7a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:24:15.323767 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.324385 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.325877 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1474/2938] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:24:15 2022] DELETE /identity/v3/projects/692178010ed841ef989712486d2f7a2d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:24:15.329872 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:15.331261 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:15.344996 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71934550-5689-47d9-ae70-7f2093b58589 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:15.400605 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:15.401156 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:15.401446 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:15.401735 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] PATH_INFO: `/v3/users/3282be75787a497e90c11ad20b6ea5ea` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:15.402858 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3282be75787a497e90c11ad20b6ea5ea)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:15.404778 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:15.449784 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3282be75787a497e90c11ad20b6ea5ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.456789 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3282be75787a497e90c11ad20b6ea5ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.457483 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3282be75787a497e90c11ad20b6ea5ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.458138 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3282be75787a497e90c11ad20b6ea5ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.465779 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3282be75787a497e90c11ad20b6ea5ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.483405 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1465/2939] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 29 02:24:15 2022] DELETE /identity/v3/users/3282be75787a497e90c11ad20b6ea5ea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:24:15.653144 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:15.654508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:15.671238 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88b037-29de-4414-951b-c65035858957 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:15.727882 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d9dd2adfb054acebc7de33da50790a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2044597fee4e41239b157ed6c7f1c415', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:15.728508 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:15.728788 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:15.729062 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] PATH_INFO: `/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:15.730314 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3a5f079d834eec98e1f7ef7e2a08e3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:15.732241 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:15.778354 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3a5f079d834eec98e1f7ef7e2a08e3', 'request_id': 'req-8d19a449-3916-48db-bb42-fa3b2a0ac197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.783791 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3a5f079d834eec98e1f7ef7e2a08e3', 'request_id': 'req-8d19a449-3916-48db-bb42-fa3b2a0ac197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.790561 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3a5f079d834eec98e1f7ef7e2a08e3', 'request_id': 'req-8d19a449-3916-48db-bb42-fa3b2a0ac197'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.803639 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] The token cache is being invalidate because project da3a5f079d834eec98e1f7ef7e2a08e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:24:15.804067 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.804728 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8d19a449-3916-48db-bb42-fa3b2a0ac197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:24:15.806434 dv-cinder-733062-36-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1475/2940] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 29 02:24:15 2022] DELETE /identity/v3/projects/da3a5f079d834eec98e1f7ef7e2a08e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:24:25.480047 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=75,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:25.799820 dv-cinder-733062-36-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:25:02.988373 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:25:02.989925 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:03.059852 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b8ef-53af-48bb-898d-280608f829b4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:25:03.120267 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f41d973ed984648b99e75f4678575d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d127ed98784cebb58caf88b1125f26', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:25:03.120880 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:25:03.121159 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:25:03.121428 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:25:03.123190 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:03.134744 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:25:03.136305 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e063db-4923-4c1c-95fe-98b0f28cf304 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:25:03.146328 dv-cinder-733062-36-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1466/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 29 02:25:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:25:13.141800 dv-cinder-733062-36-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=58 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}